-- Logs begin at Mon 2022-08-01 13:16:27 UTC, end at Mon 2022-08-01 14:29:35 UTC. -- Aug 01 14:00:04.736851 dv-cinder-847131-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 14:00:04.744918 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:00:04 2022] *** Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: nodename: dv-cinder-847131-3-iscsi Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: machine: x86_64 Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: clock source: unix Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: pcre jit disabled Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: detected number of CPU cores: 4 Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: current working directory: / Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: your processes number limit is 47680 Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: your memory page size is 4096 bytes Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: detected max file descriptor number: 2048 Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: lock engine: pthread robust mutexes Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: thunder lock: enabled Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 14:00:04.750694 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:00:04.789992 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: Python main interpreter initialized at 0x555c1cbe39c0 Aug 01 14:00:04.789992 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: python threads support enabled Aug 01 14:00:04.789992 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: your server socket listen backlog is limited to 100 connections Aug 01 14:00:04.790283 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:00:04.790613 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:00:04.790613 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: *** Operational MODE: preforking *** Aug 01 14:00:04.791066 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:00:04.791066 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: spawned uWSGI master process (pid: 103339) Aug 01 14:00:04.791308 dv-cinder-847131-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 14:00:04.793352 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: spawned uWSGI worker 1 (pid: 103340, cores: 1) Aug 01 14:00:04.793352 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: spawned uWSGI worker 2 (pid: 103341, cores: 1) Aug 01 14:00:04.793352 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:00:05.455047 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:00:05.455645 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:00:06.537444 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:00:06.537444 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: from cryptography.utils import int_from_bytes Aug 01 14:00:06.538038 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:00:06.538038 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: from cryptography.utils import int_from_bytes Aug 01 14:00:06.539853 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:00:06.539853 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: from cryptography.utils import int_from_bytes Aug 01 14:00:06.540281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:00:06.540281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: from cryptography.utils import int_from_bytes Aug 01 14:00:09.012862 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:00:09.013500 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:00:09.013632 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:00:09.013991 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:00:09.014241 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:00:09.014623 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.015052 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.015376 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.015691 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.016019 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.016326 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.016670 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.016987 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.017311 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.017568 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.017733 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:00:09.018107 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.018200 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:00:09.018307 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-3-iscsi {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.018512 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:00:09.018607 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.018815 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.018906 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:00:09.019117 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.019212 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:00:09.019432 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.019523 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.019733 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.019824 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.020051 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.020136 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.020354 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.020436 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.020813 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.020906 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.021130 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.021350 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.021462 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.021695 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.021826 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.021968 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.022081 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.022303 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.022440 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.022619 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.022744 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.022919 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.023060 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-3-iscsi {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.023234 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.023360 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.023537 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.023681 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.023844 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.023970 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.024148 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.024279 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.024455 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.024600 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-3-iscsi {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.024803 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.024929 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.025111 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.025247 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.025465 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.025618 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.025874 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.026002 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.026184 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.026310 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.026488 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.026614 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.026806 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.026931 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.027127 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.027253 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.027431 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.027549 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.027749 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.027872 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.028056 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.028208 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.028372 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.028516 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.028711 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.028838 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.029009 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.029134 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-3-iscsi {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.029314 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.029447 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.029617 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.029742 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.029930 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.030066 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.030230 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.030399 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.030535 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.030711 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.030838 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.031020 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.031147 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.031341 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.031474 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.031660 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.031793 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.031967 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.032099 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.032231 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.032380 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.032547 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.032685 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.032808 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.032930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.033083 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.033256 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.033382 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.033561 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.033688 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.033871 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.034012 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.034181 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.034307 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.034501 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.034636 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.034808 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.034934 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.035114 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.035252 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.035376 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.035499 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.035660 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.035794 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.035983 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.036127 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.036330 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.036467 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.036669 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.036792 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.036931 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.037066 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.037190 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.037366 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.037492 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.037615 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.037818 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.037950 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.038073 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.038226 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.038353 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.038542 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.038679 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.038848 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.039074 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.039212 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.039335 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.039456 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.039589 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.039758 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.039893 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.040060 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.040191 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.040362 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.040533 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.040701 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.040844 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.041032 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.041167 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.041336 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.041457 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.041583 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.041700 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.041880 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.042285 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.042639 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.042639 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.043042 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.043042 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.043237 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.043351 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.043520 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.043649 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.043871 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.043955 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.044200 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.044298 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.044540 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.044641 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.044845 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.044947 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.045147 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.045246 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.045450 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.045541 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.045753 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.045837 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.046056 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.046150 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.046355 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.046448 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.046671 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.046756 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.046982 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.047082 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.047236 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.047329 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.047540 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.047633 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.047848 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.047944 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.048151 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.048246 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.048462 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.048596 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.048788 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.048892 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.049091 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.049177 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.049395 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.049487 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.049700 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.049791 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.050001 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.050085 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.050306 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.050388 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.050608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.050739 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.050911 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.051036 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.051211 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.051336 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.051509 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.051642 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.051811 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.052444 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.052663 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.052797 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.052973 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.053100 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.053276 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.053403 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.053577 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.053710 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.053877 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.054004 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.054176 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.054309 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.054478 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.054606 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.054775 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.054902 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.055074 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.055199 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.055370 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.055496 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.055684 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.055811 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.055986 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.056109 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.056289 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.056419 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.056615 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.056753 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.056917 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.057051 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.057221 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.057354 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.057568 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.057699 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.057827 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.057950 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.058134 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.058275 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.058451 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.058586 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.058759 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.058886 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.059064 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.059192 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.059370 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.059503 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.059674 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.059800 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.059980 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.060113 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.060283 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.060408 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.060611 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.060751 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.060917 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.061044 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.061216 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.061343 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.061535 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.061667 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.061850 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.061978 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.062157 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.062281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.062463 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.062598 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.062767 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.062893 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.063080 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.063204 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:00:09.063390 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.063529 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.063706 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.063833 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.064031 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.064157 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.064349 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.064511 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.064682 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.064822 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.065023 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.065162 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.065344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.065478 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.065659 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.065791 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.065975 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.066153 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.066286 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.066417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.066587 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.066727 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.066933 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.067065 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.067186 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.067318 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.067501 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.067653 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.068381 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.068544 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.068713 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.068840 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.069030 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.069158 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.069341 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.069480 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.069652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.069780 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.069961 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.070086 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.070267 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.070391 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.070576 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.070705 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.070901 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.071024 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.071212 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.071346 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.071526 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.071653 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.071836 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.071975 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.072150 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.072277 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.072459 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.072606 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.072791 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.072909 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.073101 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.073238 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.073403 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.073537 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.073705 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.073831 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.074006 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.074142 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.074315 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.074441 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.074615 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.074740 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.074931 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.075069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.075244 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.075369 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.075548 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.075672 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.075857 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.075998 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.076167 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.076292 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.076524 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.076654 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.076792 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.076928 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.077107 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.077232 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.077409 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.077536 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.077717 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.077844 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.078025 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.078151 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.078327 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.078454 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.078650 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.078784 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.078957 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.079082 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.079259 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.079385 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.079577 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.079704 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.079880 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.080004 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.080178 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.080311 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.080502 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.080630 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.080813 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.080937 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.081124 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.081263 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.081435 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.081561 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.081747 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.081873 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.082062 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.082195 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.082370 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.082502 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.082681 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.082810 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.082991 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.083133 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.083353 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.083486 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.083658 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.083784 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.083970 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.084096 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.084279 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.084406 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.084624 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.084750 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.084930 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.085057 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.085237 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.085368 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.085539 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.085664 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.085843 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.085970 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.086145 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.086270 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.086480 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.086609 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.086740 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.086871 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.087045 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.087178 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.087346 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.087484 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.087632 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.087755 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.087935 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.088069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.088256 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.088433 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.088598 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.088756 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.088878 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.089001 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.089161 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.089307 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.089462 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.089588 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.089803 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.089929 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.090103 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.090238 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.090441 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.090567 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.090754 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.090879 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.091066 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.091193 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.091371 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.091498 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.091677 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.091810 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.091986 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.092114 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.092292 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.092423 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.092621 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.092746 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.092928 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.093055 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.093231 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.093357 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.093537 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.093663 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.093835 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.093964 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.094146 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.094273 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.094452 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.094585 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.094757 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.094881 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.095062 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.095188 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.095365 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.095566 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.095691 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.095811 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.095961 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.096086 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.096296 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.096435 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.096649 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.096776 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.096963 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.097088 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.097286 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.097423 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.097594 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.097720 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.097905 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.098031 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.098211 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.098339 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.098516 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.098642 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.098842 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.098975 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.099151 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.099278 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.099464 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.099589 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.099770 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.099907 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.100084 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.100211 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.100390 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.100546 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.100738 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.100872 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.101045 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.101183 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.101357 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.101483 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.101656 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.101783 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.101966 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.102100 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.102291 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.102417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.102620 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.102755 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.102929 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.103055 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.103238 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.103364 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.103552 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.103685 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.103857 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.103982 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.104162 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.104288 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.104467 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.104684 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.104815 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.104938 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.105081 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.105206 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.105386 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.105523 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.105697 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.105836 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.106002 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.106128 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.106307 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.106434 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.106610 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.106737 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.106921 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.107046 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.107232 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.107366 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.107533 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.107659 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.107832 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.107960 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.108141 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.108270 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.108458 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.108690 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.108817 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.108945 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.109076 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.109200 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.109398 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.109523 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.109702 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.109828 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.110003 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.110138 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.110314 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.110445 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.110618 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.110752 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.110921 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.111052 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.111220 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.111337 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.111519 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.111655 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.111833 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.111957 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.112144 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.112282 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.112444 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.112623 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.112783 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.112915 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.113094 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.113221 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.113400 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.113533 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.113690 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.113821 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.114002 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.114130 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.114307 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.114925 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.115187 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.115321 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.115499 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.115625 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.115827 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.115953 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.116136 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.116262 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.116443 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.116602 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.116793 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.116920 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.117105 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.117232 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.117411 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.117537 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.117736 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.117861 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.118009 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.118135 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.118315 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.118448 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.118619 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.118745 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.118928 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.119062 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.119242 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.119379 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.119561 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.119812 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.119937 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.120408 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.120563 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.120750 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.120878 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.121061 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.121185 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.121378 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.121502 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.121694 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.121819 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.122007 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.122133 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.122321 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.122455 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.122635 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.122761 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.122948 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.123084 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.123255 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.123387 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.123561 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.123688 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.123864 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.123989 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.124173 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.124304 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.124474 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.124617 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.124798 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.124924 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.125105 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.125241 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.125413 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.125541 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.125716 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.125979 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.126111 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.126307 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.126446 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.126613 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.126749 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.126926 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.127051 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.127234 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.127362 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.127542 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.127668 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.127844 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.127969 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.128164 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.128291 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.128471 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.128627 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.128795 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.128933 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.129098 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.129237 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.129397 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.129524 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.129724 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.129851 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.130026 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.130192 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.130893 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.131026 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.131203 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.131335 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.131513 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.131648 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.131827 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.131955 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.132132 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.132259 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.132437 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.132598 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.132769 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.132895 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.133070 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.133201 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.133375 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.133515 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.133678 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.133803 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.133985 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.134110 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.134287 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.134415 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.134595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.134720 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.134900 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.135025 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.135201 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.135327 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.135506 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.135632 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.135803 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.135932 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.136111 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.136246 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.136412 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.136580 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.136749 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.136886 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.137061 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.137189 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.137362 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.137488 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.137664 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.137802 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.137971 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.138105 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.138276 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.138402 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.138577 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.138716 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.138940 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.139075 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.139196 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.139319 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.139478 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.139606 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.139779 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.139905 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.140080 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.140204 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.140379 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.140524 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.140708 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.140834 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.141015 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.141140 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.141317 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.141445 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.141618 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.141750 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.141928 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.142047 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.142245 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.142379 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.142534 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.142660 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.142843 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.142976 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.143147 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.143274 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.143450 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.143578 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.143756 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.143889 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.144063 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.144187 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.144367 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.144545 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.144692 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.144829 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.144994 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.145126 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.145292 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.145416 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.145593 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.145757 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.145922 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.146059 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.146225 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.146356 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.146527 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.146667 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.146828 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.146952 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.147129 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.147258 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.147429 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.147553 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.147729 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.147854 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.148042 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.148177 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.148347 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.148474 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.148673 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.148796 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.148978 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.149113 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.149279 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.149406 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.149586 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.149709 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.149909 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.150031 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.150224 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.150357 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.150527 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.150658 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.150836 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.150970 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.151141 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.151269 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.151447 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.151570 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.151752 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.151889 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.152058 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.152176 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.152358 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.152541 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.152678 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.152868 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.152996 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.153119 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.153262 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.153388 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.153566 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.153702 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.153866 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.153992 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.154183 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.154316 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.154486 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.154613 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.154787 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.154914 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.155090 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.155215 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.155413 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.155539 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.155730 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.155853 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.156030 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.156154 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.156319 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.156445 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.156655 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.156793 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.156960 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.157096 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.157271 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.157405 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.157576 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.157728 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.157882 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.158017 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.158189 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.158316 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.158496 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.158630 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.158803 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.158942 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.159111 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.159238 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.159413 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.159545 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.159717 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.159852 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.160020 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.160144 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.160322 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.160449 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.160662 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.160798 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.160967 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.161092 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.161267 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.161413 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.161598 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.161726 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.161899 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.162025 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.162206 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.162332 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.162506 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.162641 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.162811 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.162936 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.163121 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.163255 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.163429 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.163563 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.163738 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.163867 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.164049 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.164177 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.164360 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.164511 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.164698 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.164826 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.165008 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.165133 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.165310 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.165438 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.165619 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.165744 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.165927 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.166062 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.166233 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.166359 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.166558 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.166685 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.166869 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.167084 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.167217 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.167349 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.167472 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.167596 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.167764 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.167899 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.168073 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.168212 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.168373 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.168545 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.168689 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.168822 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.169005 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.169138 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.169310 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.169436 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.169628 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.169756 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.170016 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.170140 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.170327 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.170452 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.170651 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.170783 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.170943 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.171076 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.171248 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.171375 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.171616 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.171741 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.171938 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.172063 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.172261 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.172391 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.172594 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.172720 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.172901 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.173035 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.173201 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.173339 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.173507 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.173633 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.173832 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.173958 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.174135 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.174270 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.174441 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.174569 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.174745 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.174870 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.175046 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.175179 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.175364 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.175490 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.175682 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.175806 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.175993 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.176130 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.176313 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.176453 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.176716 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.176851 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.177576 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.177702 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.177889 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.178016 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.178208 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.178336 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.178529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.178656 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.178834 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.178963 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.179139 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.179274 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.179447 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.179574 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.179750 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.179878 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.180054 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.180189 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.180375 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.180523 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.180705 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.180841 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.181016 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.181142 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.181325 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.181453 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.181648 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.181772 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.181921 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.182039 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.182224 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.182361 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.182548 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.182673 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.182848 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.182972 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.183168 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.183305 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.183482 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.183608 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.183803 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.183930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.184123 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.184266 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.184427 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.184610 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.184771 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.184898 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.185079 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.185207 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.185380 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.185510 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.185683 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.185809 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.185985 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.186121 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.186307 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.186434 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.186616 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.186751 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.186929 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.187058 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.187241 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.187381 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.187552 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.187680 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.187858 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.187992 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.188162 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.188296 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.188505 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.188651 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.188814 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.188939 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.189128 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.189255 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.189440 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.189574 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.189740 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.189871 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.190042 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.190170 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.190348 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.190484 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.190648 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.190775 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.190947 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.191074 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.191249 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.191383 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.191552 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.191678 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.191850 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.191974 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.192149 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.192278 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.192449 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.192628 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.192852 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.192978 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.193157 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.193287 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.193478 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.193605 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.193785 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.193914 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.194086 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.194214 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.194390 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.194517 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.194689 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.194817 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.195028 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.195164 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.195330 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.195457 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.195645 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.195782 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.195953 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.196080 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.196266 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.196394 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.196596 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.196737 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.196905 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.197032 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.197212 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.197339 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.197524 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.197662 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.197830 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.197956 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.198138 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.198262 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.198441 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.198579 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.198750 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.198875 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.199060 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.199185 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.199368 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.199494 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.199673 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.199800 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.199978 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.200104 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.200285 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.200412 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.200618 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.200755 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.200961 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.201135 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.201271 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.201463 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.201589 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.201778 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.201903 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.202087 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.202224 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.202397 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.202524 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.202708 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.202834 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.203019 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.203146 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.203328 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.203455 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.203636 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.203762 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.203943 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.204071 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.204252 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.204380 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.204599 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.204727 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.204919 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.205048 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.205243 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.205377 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.205554 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.205679 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.205871 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.205998 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.206179 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.206303 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.206491 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.206627 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.206801 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.207008 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.207144 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.207336 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.207471 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.207651 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.207779 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.207972 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.208098 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.208826 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.208972 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.209145 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.209272 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.209459 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.209586 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.209772 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.209910 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.210083 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.210208 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.210389 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.210521 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.210698 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.210900 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.211026 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.211148 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.211299 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.211426 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.211608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.211738 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.211931 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.212057 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.212262 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.212381 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.212604 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.212744 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.212914 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.213038 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.213225 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.213350 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.213537 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.213662 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.213885 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.214053 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.214187 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.214369 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.214503 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.214701 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.214827 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.215027 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.215154 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.215351 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.215479 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.215667 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.215794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.215982 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.216109 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.216292 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.216418 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.216622 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.216747 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.216934 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.217072 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.217251 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.217378 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.217564 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.217690 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.217894 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.218034 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.218211 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.218336 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.218521 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.218655 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.218825 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.218962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.219137 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.219268 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.219442 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.219566 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.219963 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.220090 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.220279 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.220397 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.220623 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.220748 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.220949 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.221078 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.221271 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.221397 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.221585 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.221709 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.221888 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.222021 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.222210 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.222337 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.222516 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.222640 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.222818 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.222950 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.223126 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.223253 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.223429 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.223562 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.223731 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.223961 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.224612 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.224810 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.224938 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.225257 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.225390 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.225572 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.225697 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.225878 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.226005 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.226189 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.226421 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.226557 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.226769 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.226896 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.227090 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.227225 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.227393 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.227517 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.227702 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.227828 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.228011 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.228138 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.228313 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.228449 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.228627 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.228753 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.228932 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.229060 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.229232 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.229365 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.229545 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.229679 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.229847 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.229974 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.230155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.230282 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.230460 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.230597 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.230766 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.230892 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.231069 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.231195 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.231374 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.231516 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.231685 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.231813 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.231988 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.232114 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.232314 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.232448 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.232641 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.232768 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.232958 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.233089 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.233265 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.233400 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.233579 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.233707 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.233885 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.234011 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.234190 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.234327 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.234496 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.234632 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.234802 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.234935 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.235117 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.235356 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.235483 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.235689 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.235817 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.236009 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.236143 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.236317 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.236443 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.236646 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.236786 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.236958 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.237094 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.237266 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.237392 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.237576 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.237702 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.237897 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.238033 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.238206 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.238342 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.238516 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.238642 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.238825 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.239034 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.239160 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.239282 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.239445 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.239574 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.239759 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.239887 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.240067 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.240193 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.240374 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.240519 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.240708 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.240982 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.241110 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.241296 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.241420 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.241601 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.241730 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.241908 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.242035 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.242214 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.242340 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.242523 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.242650 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.242853 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.242985 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.243160 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.243286 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.243470 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.243604 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.243785 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.243910 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.244094 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.244221 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.244402 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.244555 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.244733 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.244860 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.245298 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.245442 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.245610 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.245736 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.245917 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.246043 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.246230 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.246371 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.246539 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.246671 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.246843 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.246971 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.247151 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.247286 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.247460 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.247588 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.247775 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.247902 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.248086 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.248215 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.248401 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.248554 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.248768 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.248895 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.249088 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.249216 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.249395 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.249519 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.249711 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.249836 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.250018 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.250145 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.250328 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.250455 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.250641 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.250776 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.250952 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.251079 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.251263 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.251390 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.251578 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.251714 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.251883 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.252017 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.252187 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.252322 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.252523 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.252666 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.252837 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.253032 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.253157 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.253279 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.253436 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.253565 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.253739 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.253866 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.254048 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.254174 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.254349 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.254476 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.254652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.254780 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.254956 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.255101 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.255285 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.255420 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.255592 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.255719 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.255892 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.256018 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.256196 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.256366 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.256507 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.256697 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.256824 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.257027 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.257156 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.257338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.257464 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.257653 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.257811 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.257963 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.258090 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.258264 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.258387 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.258566 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.258691 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.258869 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.259002 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.259169 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.259295 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.259473 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.259597 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.259786 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.259914 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.260097 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.260222 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.260405 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.260559 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.260740 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.260865 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.261047 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.261171 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.261359 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.261492 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.261664 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.261789 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.261969 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.262102 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.262273 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.262407 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.262579 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.262711 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.262883 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.263011 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.263187 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.263307 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.263497 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.263620 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.263799 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.263923 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.264106 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.264238 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.264408 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.264586 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.264739 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.264862 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.265041 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.265167 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.265374 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.265498 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.265681 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.265807 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.266007 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.266135 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.266323 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.266449 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.266634 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.266770 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.266945 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.267083 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.267261 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.267386 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.267573 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.267707 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.267880 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.268003 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.268188 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.268322 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.268562 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.268705 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.268831 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.268954 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.269118 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.269246 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.269449 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.269584 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.269708 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.269830 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.270015 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.270141 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.270327 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.270462 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.270637 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.271256 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.271471 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.271605 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.271798 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.271926 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.272107 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.272240 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.272429 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.272582 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.272791 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.272927 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.273134 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.273261 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.273447 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.273583 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.273758 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.273884 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.274092 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.274219 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.274404 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.274543 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.274714 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.274839 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.275014 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.275139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.275262 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103340) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:00:09.275393 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.275626 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.275942 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.276253 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.276594 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.276915 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.277233 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.277567 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.277897 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.278209 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.278536 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.278865 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.279215 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.279532 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.279876 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.280209 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.280554 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.280871 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.281180 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:00:09.281422 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103341) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:00:09.428405 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Registered counter for database nova_api Aug 01 14:00:09.434178 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Registered counter for database nova_api Aug 01 14:00:09.450298 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:09.454038 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:09.457034 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:09.461441 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:09.513007 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.context [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c66651a9-c088-4404-8a00-ed3d7b34326a(cell1) {{(pid=103340) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:00:09.516739 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.context [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c66651a9-c088-4404-8a00-ed3d7b34326a(cell1) {{(pid=103341) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:00:09.516951 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:00:09.518517 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:00:09.519324 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:00:09.520690 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:00:09.522058 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:00:09.522915 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:00:09.523720 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:00:09.524025 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Registered counter for database nova_cell0 Aug 01 14:00:09.525737 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG oslo_concurrency.lockutils [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103341) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:00:09.527805 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Registered counter for database nova_cell0 Aug 01 14:00:09.529427 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Registered counter for database nova_cell1 Aug 01 14:00:09.533403 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Registered counter for database nova_cell1 Aug 01 14:00:09.536444 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:09.538691 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:09.540195 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:09.543668 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:09.543904 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:09.545932 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:09.546484 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:09.686373 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:09.688905 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO dbcounter [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Registered counter for database nova_cell0 Aug 01 14:00:09.695095 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO dbcounter [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Registered counter for database nova_cell0 Aug 01 14:00:09.698480 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_db.sqlalchemy.engines [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103340) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:09.701853 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG oslo_db.sqlalchemy.engines [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103341) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:00:09.702923 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writer thread running {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:09.706419 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writer thread running {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:00:10.046099 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:00:10.047188 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:00:10.053374 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:00:10.054469 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:00:10.402492 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:00:10.409974 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: WARNING keystonemiddleware.auth_token [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:00:10.413914 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:00:10.415316 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c1cbe39c0 pid: 103340 (default app) Aug 01 14:00:10.418086 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:00:10.419276 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001778 Aug 01 14:00:10.419680 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Mon Aug 1 14:00:10 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:00:10.421526 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: WARNING keystonemiddleware.auth_token [None req-601aa156-ebe1-4ace-ac46-31be7442b230 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:00:10.428881 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555c1cbe39c0 pid: 103341 (default app) Aug 01 14:01:26.164856 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:26.165862 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 01 14:01:26.166265 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:26.182712 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.183830 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell0:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.184852 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell1:SELECT=3 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:26.185648 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:27.046667 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a610c3cf-7dfa-48c3-8fef-c7150903c0b3 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:27.078054 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a610c3cf-7dfa-48c3-8fef-c7150903c0b3 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.904436 Aug 01 14:01:27.079224 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 14:01:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:29.266479 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:29.268036 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4b97fb39-8929-4df4-8ed1-157c20bdcf40 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Aug 01 14:01:29.268443 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:29.716389 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-20a9ff8a-3e91-42ed-9183-cd92dbe1fbf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1", "rxtx_factor": 1.0, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "vcpus": 1}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:29.738727 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:01:29.738727 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: warnings.warn(msg) Aug 01 14:01:29.769690 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-20a9ff8a-3e91-42ed-9183-cd92dbe1fbf7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.495141 Aug 01 14:01:29.777413 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:29.784865 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:29.786361 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell1:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:29.787479 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=3 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:29.788547 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:29.997536 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-53efdfec-14d6-407a-969e-eac740a40154 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:30.001967 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:01:30.001967 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Aug 01 14:01:30.065750 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-53efdfec-14d6-407a-969e-eac740a40154 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286805 Aug 01 14:01:30.066335 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 14:01:29 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:32.306502 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-20a9ff8a-3e91-42ed-9183-cd92dbe1fbf7 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:32.307519 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-20a9ff8a-3e91-42ed-9183-cd92dbe1fbf7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 01 14:01:32.312617 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:32.998971 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-80bde439-cbed-4f2c-8f85-6a9cf0e731e7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 5, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:33.020138 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:01:33.020138 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Aug 01 14:01:33.040772 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-80bde439-cbed-4f2c-8f85-6a9cf0e731e7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.726096 Aug 01 14:01:33.048509 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:33.054381 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b726a0f2-e391-4c99-9599-d0422298147f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:33.057389 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:01:33.057389 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: warnings.warn(msg) Aug 01 14:01:33.095468 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-b726a0f2-e391-4c99-9599-d0422298147f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044790 Aug 01 14:01:33.104519 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 14:01:33 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:35.279089 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-80bde439-cbed-4f2c-8f85-6a9cf0e731e7 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:35.280616 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-80bde439-cbed-4f2c-8f85-6a9cf0e731e7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001994 Aug 01 14:01:35.285831 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:35 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:35.722717 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b6e557a7-ade4-452d-bc54-6b90c46924c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "ram": 1024, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:35.742056 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-b6e557a7-ade4-452d-bc54-6b90c46924c0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455090 Aug 01 14:01:35.742601 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:35.754853 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-7082f95a-5fc6-46e3-a168-a3716e9ebc4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:35.783150 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-7082f95a-5fc6-46e3-a168-a3716e9ebc4f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031875 Aug 01 14:01:35.783833 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 14:01:35 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:37.980128 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b6e557a7-ade4-452d-bc54-6b90c46924c0 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:37.981272 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-b6e557a7-ade4-452d-bc54-6b90c46924c0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001600 Aug 01 14:01:37.981671 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:38.411860 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-b8bf5cea-c4b9-4012-a05e-92a9269b5c30 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:38.431312 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-b8bf5cea-c4b9-4012-a05e-92a9269b5c30 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.443062 Aug 01 14:01:38.431909 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:38.443900 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-1f6db3f6-30a9-434a-acc1-fc6c30ebdb71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:38.469209 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-1f6db3f6-30a9-434a-acc1-fc6c30ebdb71 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028944 Aug 01 14:01:38.469777 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 14:01:38 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:40.683964 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-b8bf5cea-c4b9-4012-a05e-92a9269b5c30 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:40.685680 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-b8bf5cea-c4b9-4012-a05e-92a9269b5c30 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001591 Aug 01 14:01:40.691700 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:41.115219 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-de438ec7-b468-43fe-af0c-d7692aae4d54 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 4096, "vcpus": 4}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:41.134952 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-de438ec7-b468-43fe-af0c-d7692aae4d54 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442032 Aug 01 14:01:41.135684 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:01:41.147990 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-bb510463-9473-4a29-a8be-51277441549f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:41.172874 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-bb510463-9473-4a29-a8be-51277441549f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028378 Aug 01 14:01:41.173668 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1335 bytes} [Mon Aug 1 14:01:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:43.348572 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-de438ec7-b468-43fe-af0c-d7692aae4d54 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:43.349538 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-de438ec7-b468-43fe-af0c-d7692aae4d54 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 01 14:01:43.349939 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:43.770539 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-cc25217f-5354-4b28-912e-2c50fee8ce3a admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:43.804633 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-cc25217f-5354-4b28-912e-2c50fee8ce3a admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.448617 Aug 01 14:01:43.805350 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 14:01:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:01:46.607501 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-de438ec7-b468-43fe-af0c-d7692aae4d54 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:46.608580 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-de438ec7-b468-43fe-af0c-d7692aae4d54 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 01 14:01:46.608986 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:47.029132 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-643f19ca-f184-4361-ae1b-d901acf2d01a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "ram": 512, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:47.052627 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-643f19ca-f184-4361-ae1b-d901acf2d01a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.435791 Aug 01 14:01:47.053650 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:47.068989 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-78504a53-e65a-48b6-9ccd-2c6cabaf0809 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:47.102219 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-78504a53-e65a-48b6-9ccd-2c6cabaf0809 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037876 Aug 01 14:01:47.102984 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 14:01:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:49.317234 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-643f19ca-f184-4361-ae1b-d901acf2d01a admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:49.318241 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-643f19ca-f184-4361-ae1b-d901acf2d01a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 01 14:01:49.318802 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:49.723270 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-eb2497f7-2606-459f-97a9-2c0bc4ee7790 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "vcpus": 1, "id": "2", "ram": 2048, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:49.743529 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-eb2497f7-2606-459f-97a9-2c0bc4ee7790 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.419024 Aug 01 14:01:49.744009 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:01:49.756193 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-95e19dcc-7d13-4868-ab56-d50369ef5c4f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:49.780394 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-95e19dcc-7d13-4868-ab56-d50369ef5c4f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027915 Aug 01 14:01:49.781018 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 14:01:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:51.989476 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-eb2497f7-2606-459f-97a9-2c0bc4ee7790 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:51.990741 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-eb2497f7-2606-459f-97a9-2c0bc4ee7790 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 01 14:01:51.991149 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:52.414741 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-aa5af5a8-1fef-4141-98e0-b814947a41db admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "3", "disk": 40, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:52.434643 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-aa5af5a8-1fef-4141-98e0-b814947a41db admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.436874 Aug 01 14:01:52.435309 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:52.447143 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-cf766f7d-983d-4c71-933c-f131478f711e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:52.472350 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-cf766f7d-983d-4c71-933c-f131478f711e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028898 Aug 01 14:01:52.473028 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 14:01:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:54.749717 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-aa5af5a8-1fef-4141-98e0-b814947a41db admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:54.751579 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-aa5af5a8-1fef-4141-98e0-b814947a41db admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002326 Aug 01 14:01:54.752144 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:55.231755 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-004adeb6-73a2-40d5-a500-c895eec204d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:55.255410 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-004adeb6-73a2-40d5-a500-c895eec204d0 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.497223 Aug 01 14:01:55.274881 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-5275b484-aa01-43ac-a9e5-cd8cb40bad1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:55.281015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:55.350056 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-5275b484-aa01-43ac-a9e5-cd8cb40bad1c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081784 Aug 01 14:01:55.364654 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 14:01:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:01:57.564860 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-004adeb6-73a2-40d5-a500-c895eec204d0 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:01:57.565881 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-004adeb6-73a2-40d5-a500-c895eec204d0 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 Aug 01 14:01:57.566470 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:01:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:01:58.046774 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4dc75b4f-f57e-4524-abf2-95bb563cab9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "vcpus": 8, "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:58.068204 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4dc75b4f-f57e-4524-abf2-95bb563cab9c admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.495868 Aug 01 14:01:58.069394 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1282 bytes} [Mon Aug 1 14:01:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:01:58.081738 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-c746c816-a7d6-4e0a-b0d9-ed402b6dfd21 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:01:58.086743 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:01:58.109843 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-c746c816-a7d6-4e0a-b0d9-ed402b6dfd21 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031749 Aug 01 14:01:58.111330 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1332 bytes} [Mon Aug 1 14:01:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:02:18.857466 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4dc75b4f-f57e-4524-abf2-95bb563cab9c admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:18.858472 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4dc75b4f-f57e-4524-abf2-95bb563cab9c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 01 14:02:18.858872 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:19.252699 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-0fbb1fe2-fcc5-469d-988e-9e520205a03f admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:19.270333 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-0fbb1fe2-fcc5-469d-988e-9e520205a03f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.405402 Aug 01 14:02:19.270870 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 14:02:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:20.331081 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4dc75b4f-f57e-4524-abf2-95bb563cab9c admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:20.332082 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4dc75b4f-f57e-4524-abf2-95bb563cab9c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 01 14:02:20.332508 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:02:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:20.859777 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4c5a9120-ab60-4bff-a8a0-4f5722239fc4 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:20.865880 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-4c5a9120-ab60-4bff-a8a0-4f5722239fc4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4c5a9120-ab60-4bff-a8a0-4f5722239fc4 admin admin] Request method failure captured: Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Accept: application/json Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Connection: keep-alive Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Content-Length: 0 Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Host: 10.222.0.48 Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABi59zs6wtBcsjlHogqfa5Wou1GbvepUBmEiNPmjcBxIgqule9aUIssrifmAvnOeZN8O9IUcnbciRJpk9bu_FBmxA_t4mZmkMkJNRLEYSGeAb6uRGqH5W8c2TLI57msH9lWDbKPVq56Ww4GHyip3ETZ6Q84LXWub36-_yVVbjCTqsNpC84 Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Role: admin,reader,member Aug 01 14:02:20.869171 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Roles: admin,reader,member Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}] Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant: admin Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User: admin Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Id: 7d5a51326470403490a7155c74035d21 Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Name: admin Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: method: > Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: exception: Flavor 42 could not be found. Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: action_args: {'id': '42'} Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:02:20.870930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:20.871794 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.872962 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4c5a9120-ab60-4bff-a8a0-4f5722239fc4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:02:20.874328 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-4c5a9120-ab60-4bff-a8a0-4f5722239fc4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.392424 Aug 01 14:02:20.874328 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 14:02:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:02:20.880419 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-4726b677-0b69-4178-a6e0-bbb4740cc5f7 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:20.884686 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:02:20.904392 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-4726b677-0b69-4178-a6e0-bbb4740cc5f7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027491 Aug 01 14:02:20.904974 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 14:02:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:20.914672 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a7926794-f199-4ec5-98de-c96b6f52c552 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:20.938922 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a7926794-f199-4ec5-98de-c96b6f52c552 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027857 Aug 01 14:02:20.939457 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 14:02:20 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:20.949347 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-1e6b8f50-7d69-4e78-94de-3f5a8f529294 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:20.955792 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-1e6b8f50-7d69-4e78-94de-3f5a8f529294 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-1e6b8f50-7d69-4e78-94de-3f5a8f529294 admin admin] Request method failure captured: Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Accept: application/json Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Connection: keep-alive Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Content-Length: 0 Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Host: 10.222.0.48 Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABi59zs6wtBcsjlHogqfa5Wou1GbvepUBmEiNPmjcBxIgqule9aUIssrifmAvnOeZN8O9IUcnbciRJpk9bu_FBmxA_t4mZmkMkJNRLEYSGeAb6uRGqH5W8c2TLI57msH9lWDbKPVq56Ww4GHyip3ETZ6Q84LXWub36-_yVVbjCTqsNpC84 Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Role: admin,reader,member Aug 01 14:02:20.959155 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Roles: admin,reader,member Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}] Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant: admin Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User: admin Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Id: 7d5a51326470403490a7155c74035d21 Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Name: admin Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: method: > Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: exception: Flavor 42 could not be found. Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: action_args: {'id': '42'} Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:02:20.960652 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:20.961595 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:20.963281 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-1e6b8f50-7d69-4e78-94de-3f5a8f529294 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:02:20.964287 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-1e6b8f50-7d69-4e78-94de-3f5a8f529294 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015240 Aug 01 14:02:20.964287 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 14:02:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:02:21.929080 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a7926794-f199-4ec5-98de-c96b6f52c552 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:21.930087 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a7926794-f199-4ec5-98de-c96b6f52c552 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 01 14:02:21.930476 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:02:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:22.474327 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-396cd685-843e-4eec-afed-0c582b6e9b89 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:22.479667 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-396cd685-843e-4eec-afed-0c582b6e9b89 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-396cd685-843e-4eec-afed-0c582b6e9b89 admin admin] Request method failure captured: Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Accept: application/json Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Connection: keep-alive Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Content-Length: 0 Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Host: 10.222.0.48 Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABi59zty9quVHEICo4nn46MDAWFSNobLBwsBDK9p0t1JGAYTjD0RlYx1kzsdindFaLGxbP9biZAjfgTwfdV0xnjlBln63Zx17fUdTi5vIyUIg1uNEGyRdAUZVZuKqSuS4O_-HLyqSwLBsjDriH_deW5_waCxMrQTU3gYwgi5aXkrn2lE0g Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Role: admin,reader,member Aug 01 14:02:22.481154 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Roles: admin,reader,member Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}] Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant: admin Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User: admin Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Id: 7d5a51326470403490a7155c74035d21 Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Name: admin Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: method: > Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: exception: Flavor 84 could not be found. Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: action_args: {'id': '84'} Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:02:22.482625 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:22.483515 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.484608 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-396cd685-843e-4eec-afed-0c582b6e9b89 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:02:22.485618 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-396cd685-843e-4eec-afed-0c582b6e9b89 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.415316 Aug 01 14:02:22.485618 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 14:02:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 416 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:02:22.492706 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-a693d87c-100e-4be8-95ce-bafbc6555210 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:22.507100 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-a693d87c-100e-4be8-95ce-bafbc6555210 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018587 Aug 01 14:02:22.507607 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 14:02:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:22.517304 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-96a12d34-d057-4940-85bb-b35e22fd712c admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:22.532627 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-96a12d34-d057-4940-85bb-b35e22fd712c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018694 Aug 01 14:02:22.533153 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 14:02:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:22.542058 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ea96b912-262a-44c4-9c42-c13eb52ff1ae admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:22.547542 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-ea96b912-262a-44c4-9c42-c13eb52ff1ae admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ea96b912-262a-44c4-9c42-c13eb52ff1ae admin admin] Request method failure captured: Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Accept: application/json Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Connection: keep-alive Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Content-Length: 0 Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Host: 10.222.0.48 Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABi59zty9quVHEICo4nn46MDAWFSNobLBwsBDK9p0t1JGAYTjD0RlYx1kzsdindFaLGxbP9biZAjfgTwfdV0xnjlBln63Zx17fUdTi5vIyUIg1uNEGyRdAUZVZuKqSuS4O_-HLyqSwLBsjDriH_deW5_waCxMrQTU3gYwgi5aXkrn2lE0g Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Role: admin,reader,member Aug 01 14:02:22.549069 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Roles: admin,reader,member Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}] Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant: admin Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User: admin Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Id: 7d5a51326470403490a7155c74035d21 Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Name: admin Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: method: > Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: exception: Flavor 84 could not be found. Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: action_args: {'id': '84'} Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:02:22.550344 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:22.551123 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:22.552139 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-ea96b912-262a-44c4-9c42-c13eb52ff1ae admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:02:22.553190 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-ea96b912-262a-44c4-9c42-c13eb52ff1ae admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011809 Aug 01 14:02:22.553190 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Mon Aug 1 14:02:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 14:02:23.533397 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-96a12d34-d057-4940-85bb-b35e22fd712c admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:23.534407 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-96a12d34-d057-4940-85bb-b35e22fd712c admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 01 14:02:23.534802 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:02:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:24.059151 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4e7ea250-e764-452a-a265-cb77b7443384 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:24.064839 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.wsgi [None req-4e7ea250-e764-452a-a265-cb77b7443384 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4e7ea250-e764-452a-a265-cb77b7443384 admin admin] Request method failure captured: Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Accept: application/json Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Accept-Encoding: gzip, deflate Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Connection: keep-alive Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Content-Length: 0 Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Host: 10.222.0.48 Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Openstack-Api-Version: compute 2.90 Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Openstack-System-Scope: None Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: User-Agent: python-novaclient Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Auth-Token: gAAAAABi59zvTumjDn51iH1WWNAKL7LM2ur00PnbU2w0I1BPCMgd3TOJ5XIu6mJuVSepWOxm5AsZJu5dricmfcmKXW5fkPKeu6HsUeQdVNxqbQq01lvoy1gM-GrL8mFAspFI2t-GhOTrjqfIIRhR_cr_SdW3bO_mOyYYaEK2dYYCvb7NO0nQ5Q0 Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Domain-Id: None Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Domain-Name: None Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Identity-Status: Confirmed Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Is-Admin-Project: True Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Domain-Id: default Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Domain-Name: Default Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Project-Name: admin Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Role: admin,reader,member Aug 01 14:02:24.066338 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Roles: admin,reader,member Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}] Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant: admin Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-Tenant-Name: admin Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User: admin Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Domain-Id: default Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Domain-Name: Default Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Id: 7d5a51326470403490a7155c74035d21 Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: X-User-Name: admin Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: method: > Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: exception: Flavor 451 could not be found. Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: action_args: {'id': '451'} Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:02:24.067957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:24.069015 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.070417 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-4e7ea250-e764-452a-a265-cb77b7443384 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103341) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:02:24.072530 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-4e7ea250-e764-452a-a265-cb77b7443384 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.395506 Aug 01 14:02:24.072530 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 14:02:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 01 14:02:24.078070 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-f23781ff-b992-4577-8c7e-19f91724ed3d admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:24.093307 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-f23781ff-b992-4577-8c7e-19f91724ed3d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018783 Aug 01 14:02:24.093826 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 14:02:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:24.103063 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:24.117799 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018211 Aug 01 14:02:24.118316 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Mon Aug 1 14:02:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:02:24.127600 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-653bc4fc-2748-4631-9be0-a5f9651cd2fa admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:24.132851 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.wsgi [None req-653bc4fc-2748-4631-9be0-a5f9651cd2fa admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-653bc4fc-2748-4631-9be0-a5f9651cd2fa admin admin] Request method failure captured: Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Accept: application/json Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Accept-Encoding: gzip, deflate Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Connection: keep-alive Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Content-Length: 0 Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Host: 10.222.0.48 Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Openstack-Api-Version: compute 2.90 Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Openstack-System-Scope: None Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: User-Agent: python-novaclient Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Auth-Token: gAAAAABi59zvTumjDn51iH1WWNAKL7LM2ur00PnbU2w0I1BPCMgd3TOJ5XIu6mJuVSepWOxm5AsZJu5dricmfcmKXW5fkPKeu6HsUeQdVNxqbQq01lvoy1gM-GrL8mFAspFI2t-GhOTrjqfIIRhR_cr_SdW3bO_mOyYYaEK2dYYCvb7NO0nQ5Q0 Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Domain-Id: None Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Domain-Name: None Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Identity-Status: Confirmed Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Is-Admin-Project: True Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Openstack-Nova-Api-Version: 2.90 Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Domain-Id: default Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Domain-Name: Default Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Project-Name: admin Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Role: admin,reader,member Aug 01 14:02:24.134979 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Roles: admin,reader,member Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b30b7ebe5b2d4e7c8f161e5b78a7a0df"}]}] Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant: admin Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant-Id: b30b7ebe5b2d4e7c8f161e5b78a7a0df Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-Tenant-Name: admin Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User: admin Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Domain-Id: default Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Domain-Name: Default Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Id: 7d5a51326470403490a7155c74035d21 Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: X-User-Name: admin Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: method: > Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: exception: Flavor 451 could not be found. Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: action_args: {'id': '451'} Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:02:24.136529 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:24.137415 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: ERROR nova.api.openstack.wsgi Aug 01 14:02:24.138510 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-653bc4fc-2748-4631-9be0-a5f9651cd2fa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103340) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:02:24.139496 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-653bc4fc-2748-4631-9be0-a5f9651cd2fa admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012284 Aug 01 14:02:24.139496 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 14:02:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 01 14:02:25.102738 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:25.104444 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002107 Aug 01 14:02:25.104862 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:02:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:25.631063 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-bee034e9-54a3-4d33-98dc-12f676e97947 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:02:25.650594 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-bee034e9-54a3-4d33-98dc-12f676e97947 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402406 Aug 01 14:02:25.651130 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 14:02:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:26.613244 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:26.614496 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Aug 01 14:02:26.614905 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:02:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:27.136814 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-24133445-0a02-42ad-a1d6-cc9a30844f0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:02:27.155289 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-24133445-0a02-42ad-a1d6-cc9a30844f0f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.400910 Aug 01 14:02:27.155853 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 14:02:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:28.122450 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:28.123472 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 01 14:02:28.123861 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:02:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:28.770715 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c418f9b3-3ef9-4c61-a3ea-d95f717408c5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:02:28.789699 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c418f9b3-3ef9-4c61-a3ea-d95f717408c5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.529690 Aug 01 14:02:28.790301 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 14:02:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:02:29.746151 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:29.747156 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 01 14:02:29.747580 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:30.262212 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-d75fd7c6-9f99-4425-a90f-8a88a82c362a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:02:30.281835 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-d75fd7c6-9f99-4425-a90f-8a88a82c362a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.396936 Aug 01 14:02:30.282406 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Mon Aug 1 14:02:29 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:02:31.262242 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:31.263258 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 01 14:02:31.263660 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:02:31.792534 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-3326d2dc-a5f5-4a3a-a668-e6c2a984f6ce admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:02:31.812427 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-3326d2dc-a5f5-4a3a-a668-e6c2a984f6ce admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.410631 Aug 01 14:02:31.812997 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Mon Aug 1 14:02:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:03:23.210921 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:03:23.211953 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-d3d21f57-32fb-4ee9-ae13-a4580bdd26ed admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 01 14:03:23.212350 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 930 bytes} [Mon Aug 1 14:03:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:03:23.222796 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:23.607046 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-c66e0e4e-9ef7-41bb-b08f-65cf22a0b82e admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:03:23.627167 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-c66e0e4e-9ef7-41bb-b08f-65cf22a0b82e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.408892 Aug 01 14:03:23.627693 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1291 bytes} [Mon Aug 1 14:03:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:03:23.650654 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-b58af882-bcff-4536-b7f6-7d6ba385b3e9 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:03:23.654135 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG dbcounter [-] [103341] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103341) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:03:23.661331 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-b58af882-bcff-4536-b7f6-7d6ba385b3e9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013935 Aug 01 14:03:23.661849 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1282 bytes} [Mon Aug 1 14:03:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:03:23.673275 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-a29a50dc-b66f-4e66-ada8-169c8c9477b4 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:03:23.680734 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-a29a50dc-b66f-4e66-ada8-169c8c9477b4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011086 Aug 01 14:03:23.681245 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1285 bytes} [Mon Aug 1 14:03:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:03:23.692501 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:03:23.700930 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011819 Aug 01 14:03:23.701391 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1285 bytes} [Mon Aug 1 14:03:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:03:23.713168 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-80d1a916-e39d-4e08-8f73-5d3fd44c29c9 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:03:23.720598 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-80d1a916-e39d-4e08-8f73-5d3fd44c29c9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010920 Aug 01 14:03:23.721098 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1282 bytes} [Mon Aug 1 14:03:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:06:49.171358 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:49.172372 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Aug 01 14:06:49.172803 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:06:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:06:49.311256 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=6 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:06:49.471872 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-e91964a3-8308-41d0-b068-6364e991c237 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:49.474236 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:06:49.474236 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Aug 01 14:06:49.475438 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-e91964a3-8308-41d0-b068-6364e991c237 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:49.476123 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-e91964a3-8308-41d0-b068-6364e991c237 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:49.476951 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-e91964a3-8308-41d0-b068-6364e991c237 admin admin] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:49.477373 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-e91964a3-8308-41d0-b068-6364e991c237 admin admin] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:49.510149 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-e91964a3-8308-41d0-b068-6364e991c237 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.200258 Aug 01 14:06:49.510702 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 14:06:49 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:06:50.331455 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:50.332497 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 01 14:06:50.332915 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:06:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:06:50.524038 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-e6d4122c-095c-407d-ad82-549b1a56c97c admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:06:50.526441 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:06:50.526441 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Aug 01 14:06:50.527860 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-e6d4122c-095c-407d-ad82-549b1a56c97c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:50.528303 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-e6d4122c-095c-407d-ad82-549b1a56c97c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:50.529134 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-e6d4122c-095c-407d-ad82-549b1a56c97c admin admin] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:06:50.529562 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-e6d4122c-095c-407d-ad82-549b1a56c97c admin admin] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:06:50.549240 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-e6d4122c-095c-407d-ad82-549b1a56c97c admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076552 Aug 01 14:06:50.549718 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 14:06:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:07:01.782080 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:07:01.783103 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Aug 01 14:07:01.783496 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:07:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:07:01.925003 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell0:SELECT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:01.925722 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_cell1:SELECT=4 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:01.926366 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG dbcounter [-] [103340] Writing DB stats nova_api:SELECT=8 {{(pid=103340) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:01.973679 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-8ac5292c-70ba-4846-886c-008e8264c680 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:07:01.976316 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:07:01.976316 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Aug 01 14:07:01.977556 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-8ac5292c-70ba-4846-886c-008e8264c680 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:07:01.978029 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-8ac5292c-70ba-4846-886c-008e8264c680 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:07:01.978820 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-8ac5292c-70ba-4846-886c-008e8264c680 admin admin] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:07:01.979244 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-8ac5292c-70ba-4846-886c-008e8264c680 admin admin] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:07:02.003482 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-8ac5292c-70ba-4846-886c-008e8264c680 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.082937 Aug 01 14:07:02.003963 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 14:07:01 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:07:02.835724 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: DEBUG nova.api.openstack.wsgi [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] Calling method '>' {{(pid=103341) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:07:02.836957 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: INFO nova.api.openstack.requestlog [None req-9946858a-ef6a-493a-bc96-585a8e9a6476 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Aug 01 14:07:02.837352 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: [pid: 103341|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Mon Aug 1 14:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:07:03.027280 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG nova.api.openstack.wsgi [None req-1b4aa399-a335-4c93-a5d2-979e1d4c39d8 admin admin] Calling method '>' {{(pid=103340) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:07:03.030291 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:07:03.030291 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: warnings.warn(msg) Aug 01 14:07:03.031478 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-1b4aa399-a335-4c93-a5d2-979e1d4c39d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:07:03.031931 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-1b4aa399-a335-4c93-a5d2-979e1d4c39d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:07:03.032749 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-1b4aa399-a335-4c93-a5d2-979e1d4c39d8 admin admin] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:07:03.033184 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: DEBUG oslo_concurrency.lockutils [None req-1b4aa399-a335-4c93-a5d2-979e1d4c39d8 admin admin] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103340) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:07:03.055188 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: INFO nova.api.openstack.requestlog [None req-1b4aa399-a335-4c93-a5d2-979e1d4c39d8 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079203 Aug 01 14:07:03.055674 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: [pid: 103340|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Mon Aug 1 14:07:02 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:08:02.661045 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: Mon Aug 1 14:08:02 2022 - graceful shutdown triggered... Aug 01 14:08:02.661524 dv-cinder-847131-3-iscsi devstack@n-api.service[103341]: Gracefully killing worker 2 (pid: 103341)... Aug 01 14:08:02.661156 dv-cinder-847131-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 01 14:08:02.662304 dv-cinder-847131-3-iscsi devstack@n-api.service[103340]: Gracefully killing worker 1 (pid: 103340)... Aug 01 14:08:03.662195 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: worker 1 buried after 1 seconds Aug 01 14:08:03.662767 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: worker 2 buried after 1 seconds Aug 01 14:08:03.662767 dv-cinder-847131-3-iscsi devstack@n-api.service[103339]: goodbye to uWSGI. Aug 01 14:08:03.663808 dv-cinder-847131-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 01 14:08:03.664374 dv-cinder-847131-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 01 14:08:03.667235 dv-cinder-847131-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 01 14:08:03.677041 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:08:03 2022] *** Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: nodename: dv-cinder-847131-3-iscsi Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: machine: x86_64 Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: clock source: unix Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: pcre jit disabled Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: detected number of CPU cores: 4 Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: current working directory: / Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: your processes number limit is 47680 Aug 01 14:08:03.679033 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: your memory page size is 4096 bytes Aug 01 14:08:03.679953 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: detected max file descriptor number: 2048 Aug 01 14:08:03.679953 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: lock engine: pthread robust mutexes Aug 01 14:08:03.679953 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: thunder lock: enabled Aug 01 14:08:03.679953 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 01 14:08:03.679953 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:08:03.719075 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: Python main interpreter initialized at 0x55b66d7529c0 Aug 01 14:08:03.719075 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: python threads support enabled Aug 01 14:08:03.719075 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: your server socket listen backlog is limited to 100 connections Aug 01 14:08:03.719075 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:08:03.719508 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:08:03.719508 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: *** Operational MODE: preforking *** Aug 01 14:08:03.719931 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:08:03.719931 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: spawned uWSGI master process (pid: 117845) Aug 01 14:08:03.720010 dv-cinder-847131-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 01 14:08:03.721571 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: spawned uWSGI worker 1 (pid: 117857, cores: 1) Aug 01 14:08:03.725372 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: spawned uWSGI worker 2 (pid: 117859, cores: 1) Aug 01 14:08:03.725706 dv-cinder-847131-3-iscsi devstack@n-api.service[117845]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:08:04.396549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:08:04.397154 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 01 14:08:05.546914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:08:05.546914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: from cryptography.utils import int_from_bytes Aug 01 14:08:05.547572 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:08:05.547572 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: from cryptography.utils import int_from_bytes Aug 01 14:08:05.554654 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:08:05.554654 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: from cryptography.utils import int_from_bytes Aug 01 14:08:05.555107 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:08:05.555107 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: from cryptography.utils import int_from_bytes Aug 01 14:08:07.934848 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:08:07.935529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:08:07.935638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:08:07.935996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:08:07.936256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:08:07.936678 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.937012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.937341 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.937668 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.938003 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.938317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.938644 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.938974 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.939311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.939573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.939893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.940222 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-3-iscsi {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.940569 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.941054 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.941378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.941714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.942021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.942352 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.942664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.943178 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.943934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.944253 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.944626 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.945043 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.945318 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.945637 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.945967 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.950438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.950438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.950438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.950438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-3-iscsi {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.950438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.950438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.950438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.950438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.952254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.952254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.952254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.952254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.952254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.952254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.952254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.952254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.953950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.953950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.953950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.953950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.954614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.954614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.954614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.955129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.955282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.955547 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.955715 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:08:07.956196 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.956347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:08:07.956544 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.956544 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.956866 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:08:07.957021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.957187 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:08:07.957335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.957487 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:08:07.957651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.957805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.958026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.958175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.958329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.958481 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.958637 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.958782 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.958942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.959095 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.959249 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.959408 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.959554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.959722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.959889 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.960037 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.960313 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.960505 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.960672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.960829 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.960977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.961122 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.961275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.961428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847131-3-iscsi {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.961574 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.961746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.961893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.962060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.962207 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.962360 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.962514 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.962514 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.962804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.962804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.963094 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.963246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.963390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.963548 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.963711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.963711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.964002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.964176 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.964340 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.964541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.964696 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.964840 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.964994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.965147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.965312 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.965475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.966243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.966406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.966561 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.966716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.966870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.967021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.967166 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.967318 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.967472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.967626 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.967779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.967924 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.968080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847131-3-iscsi {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.968225 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.968380 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.968571 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.968732 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.968878 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.969021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.969183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.969338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.969486 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.969644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.969794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.969947 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.970120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.971346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.971511 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.971511 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.971792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.971948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.972353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.972543 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.972709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.972863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.973015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.973160 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.973333 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.973486 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.973641 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.973794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.973985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.974142 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.974297 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.974450 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.974594 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.974739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.974929 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.975089 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.975242 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.975242 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.976163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.976326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.976509 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.976674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.976823 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.976967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.977122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.977275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.977429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.977582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.977738 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.977904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.978062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.978209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.978355 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.978512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.978659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.978813 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.978970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.979116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.979260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.979412 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.979563 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.979738 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.979893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.980039 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.980193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.980345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.980508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.980676 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.980822 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.980967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.981134 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.981293 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.981447 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.981606 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.981769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.981923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.982203 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.982371 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.982527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.982710 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.982867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.983069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.983256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.983402 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.983556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.983710 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.983867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.984032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.984221 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.984381 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.984579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.984740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.984894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.985047 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.985193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.985384 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.985544 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.985698 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.985862 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.986103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.986263 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.986423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.986569 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.986723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.986868 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.987021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.987168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.987323 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.987469 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.987620 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.987620 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.987894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.988060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.988294 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.988450 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.988622 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.988780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.988936 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.989081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.989242 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.989397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.989548 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.989712 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.989865 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.990024 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.990188 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.990342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.990495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.990640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.990784 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.991001 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.991148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.991292 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.991444 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.991640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.991792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.991952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.991952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.992351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.992537 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.992707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.992860 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.993016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.993170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.993316 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.993460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.993604 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.993757 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.993910 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.994063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.994218 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.994371 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.994516 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.994670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.994815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.994966 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.995120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.995273 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.995425 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.995570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.995714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.995858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.996022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.996277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.996429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.996613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.996796 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.996944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.996944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.997237 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.997391 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.997543 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.997689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.997843 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.998002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.998148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.998303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.998457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.998603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.998762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.998915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.999067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.999226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.999386 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.999539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:07.999688 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:07.999868 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.000032 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.000205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.000351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.000557 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.000711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.000869 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.001016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.001160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.001304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.001448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.001448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.001448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.001863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.002017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.002180 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.002354 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.002598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.002762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.002909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.003056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:08:08.003201 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.003352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.003508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.003669 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.003823 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.003977 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.004134 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.004298 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.004454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.004634 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.004795 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.004993 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.005175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.005329 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.005489 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.005635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.005791 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.005944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.006090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.006262 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.006509 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.006661 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.006807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.006959 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.006959 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.007268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.007426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.007579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.007579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.007863 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.008013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.008168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.008333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.008526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.008692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.008847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.008999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.009155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.009309 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.009464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.009628 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.009774 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.009926 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.010085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.010231 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.010387 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.010533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.010689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.010844 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.010997 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.011143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.011288 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.011433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.011578 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.011731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.011876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.012028 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.012173 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.012864 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.013109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.013272 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.013431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.013588 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.013733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.013877 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.014021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.014176 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.014322 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.014473 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.014626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.014786 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.015019 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.015167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.015312 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.015464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.015623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.015775 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.015934 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.016087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.016240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.016393 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.016643 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.016796 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.016970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.016970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.016970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.017374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.017518 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.017671 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.017831 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.017976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.018129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.018274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.018426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.018578 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.018738 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.018895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.019042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.019194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.019341 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.019497 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.019652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.019806 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.019959 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.019959 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.020260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.020415 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.020597 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.020755 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.020912 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.021065 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.021218 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.021894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.022055 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.022209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.022364 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.022510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.022663 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.022822 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.022969 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.023141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.023380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.023549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.023711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.023857 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.024010 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.024164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.024317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.024474 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.024676 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.024824 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.024978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.025124 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.025277 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.025442 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.025599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.025756 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.025909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.026027 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.026138 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.026258 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.026385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.026499 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.026776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.026932 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.027081 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.027239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.027403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.027550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.027694 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.027837 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.028010 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.028212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.028903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.029060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.029060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.029357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.029503 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.029657 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.029811 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.029984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.030154 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.030154 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.030154 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.030572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.030718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.030870 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.031024 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.031177 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.031333 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.031492 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.031639 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.031783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.031938 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.032083 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.032237 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.032384 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.032557 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.032709 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.032854 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.033008 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.033163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.033163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.033561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.033713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.033878 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.034034 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.034234 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.034402 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.034558 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.034713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.034860 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.035016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.035163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.035309 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.035309 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.035593 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.035750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.035990 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.036156 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.036303 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.036448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.036665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.036846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.037089 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.037242 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.037387 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.037540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.037540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.037815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.037974 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.038139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.038286 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.038430 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.038582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.038582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.038582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.039133 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.039283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.039429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.039574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.039730 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.039883 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.040033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.040197 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.040343 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.040516 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.040682 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.040830 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.040975 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.041129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.041274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.041427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.041586 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.041742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.041889 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.042044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.042212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.042359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.042519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.042665 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.042811 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.042963 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.043116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.043275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.043421 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.043605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.043861 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.044021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.044021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.044336 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.044522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.044687 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.044835 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.044981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.045126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.045350 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.045506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.045651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.045795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.045947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.046093 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.046262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.046418 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.046563 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.046716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.046869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.047025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.047025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.047423 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.047571 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.047715 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.047860 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.048018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.048172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.048328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.048500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.048664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.048819 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.048974 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.049121 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.049272 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.049425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.049569 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.049728 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.049897 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.050054 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.050207 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.050368 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.050520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.050684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.050836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.050996 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.051147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.051298 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.051456 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.051618 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.051618 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.051905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.052056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.052218 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.052370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.052578 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.052747 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.052747 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.053043 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.053194 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.053345 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.053505 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.053664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.053838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.054108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.054275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.054455 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.054608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.054766 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.054919 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.055082 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.055234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.055395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.055555 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.055707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.055866 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.056027 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.056196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.056358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.056560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.056798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.056978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.057132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.057308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.057550 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.057717 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.057878 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.058040 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.058193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.058345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.058505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.058667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.058830 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.058996 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.059150 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.059341 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.059495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.059656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.059815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.059982 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.060136 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.060296 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.060448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.060676 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.060843 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.061016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.061178 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.061331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.061491 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.061644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.061805 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.061967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.062121 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.062273 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.062431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.062584 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.062750 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.062921 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.063081 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.063241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.063394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.063546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.063546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.063851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.064011 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.064265 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.064433 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.064629 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.064791 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.064945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.064945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.065254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.065415 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.065576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.065736 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.065890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.066042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.066194 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.066352 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.066514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.066666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.066818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.066990 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.067143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.067309 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.067468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.067712 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.067872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.068026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.068234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.068397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.068604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.068762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.068924 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.069088 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.069253 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.069405 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.069556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.069707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.069867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.070033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.070187 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.070347 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.070499 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.070658 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.070825 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.070977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.071138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.071301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.071453 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.071611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.071778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.071931 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.072091 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.072244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.072403 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.072403 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.072745 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.072900 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.073061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.073222 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.073392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.073546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.073711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.073873 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.074026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.074184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.074449 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.074623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.074777 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.075549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.075715 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.075869 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.076028 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.076268 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.076433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.076623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.076778 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.076930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.077090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.077090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.077400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.077553 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.077733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.077733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.078126 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.078306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.078461 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.078613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.078771 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.078932 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.079098 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.079251 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.079402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.079554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.079713 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.079876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.080044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.080198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.080368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.080554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.080724 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.080884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.081050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.081211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.081363 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.081521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.081682 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.081842 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.082008 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.082161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.082320 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.082492 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.082653 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.082819 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.082980 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.083176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.083347 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.083509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.083670 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.083897 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.084059 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.084211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.084211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.084630 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.084802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.084974 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.085129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.085289 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.085449 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.085601 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.085760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.085926 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.086079 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.086229 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.086387 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.086549 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.086727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.086891 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.087044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.087195 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.087353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.087505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.087666 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.087827 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.087999 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.088227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.088400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.089164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.089347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.089347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.089347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.089825 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.089985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.090137 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.090299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.090478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.091148 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.091666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.091832 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.092002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.092172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.092333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.092529 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.092529 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.092839 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.093002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.093165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.093319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.093478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.093638 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.093798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.093964 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.094117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.094277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.094429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.094619 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.094866 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.097463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.097632 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.097799 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.097963 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.098127 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.098395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.098575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.098738 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.098892 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.098892 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.098892 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.099362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.099526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.099679 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.099847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.100012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.100166 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.100329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.100556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.100730 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.100885 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.101037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.101190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.101368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.101523 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.101683 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.101836 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.101988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.102151 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.102312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.102473 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.102627 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.102778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.102930 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.103096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.103096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.103410 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.103570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.103733 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.103886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.104047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.104200 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.104350 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.104532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.104705 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.104886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.105148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.105307 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.105459 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.105623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.105776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.105928 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.106607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.106779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.106941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.107103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.107263 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.107425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.107585 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.107746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.107899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108051 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108221 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108408 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108657 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108817 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.108971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.109706 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.109866 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.110025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.110188 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.110354 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.110506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.110664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.110817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.110978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.111145 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.111298 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.111457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.111609 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.111768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.111768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.112078 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.112241 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.112393 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.112614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.112782 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.112943 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.113106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.113106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.113404 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.113564 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.113717 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.113877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.114030 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.114182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.114352 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.114513 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.114675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.114675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.114985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.115157 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.115414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.115573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.115734 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.115901 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116062 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116062 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.116884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.118012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.118012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.118012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.118012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.118012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.118012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.118012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.118012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.119391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.119560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.119723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.119895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.120050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.120216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.120392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.120597 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.120754 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.120907 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.121059 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.121221 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.121382 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.121544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.121731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.122406 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.122572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.122736 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.122890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.123041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.123204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.123365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.123518 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.123681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.123834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.123994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.124154 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.124308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.124469 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.124675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.124836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.124996 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.125168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.125322 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.125587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.125750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.125911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.126064 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.126217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.126379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.126545 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.126700 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.126860 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.127013 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.127171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.127342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.127506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.127667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.127828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.127981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.128132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.128293 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.128447 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.128627 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.128800 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.128800 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.129185 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.129351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.129524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.129678 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.129839 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.129839 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.130130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.130292 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.130445 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.130605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.130765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.130918 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.131070 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.131231 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.131384 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.131547 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.131715 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.131876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.132040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.132194 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.132346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.132546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.132707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.132870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.133034 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.133195 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.133355 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.133528 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.133681 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.133833 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.133994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.134155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.134307 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.134465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.134619 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.134778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.134946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.135108 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.135261 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.135419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.135604 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.135855 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.136014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.136175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.136336 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.136516 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.136677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.136842 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.136996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.137158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.137334 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.137495 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.137655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.137829 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.137983 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.138142 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.138304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.138457 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.138608 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.138771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.138950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.138950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.139454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.139607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.139773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.139773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.140095 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.140249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.140249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.140249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.140720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.140875 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.141026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.141177 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.141328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.141488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.141724 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.141879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.142051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.142205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.142356 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.142522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.142675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.142828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.142987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.143148 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.143308 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.143472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.143624 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.143785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.143937 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.144118 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.144280 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.144444 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.144640 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.144796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.144948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.145099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.145251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.145417 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.145579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.145732 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.145732 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.146130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.146307 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.146476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.146639 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.146793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.146958 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.147112 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.147277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.147438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.147598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.147759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.147912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.148064 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.148238 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.148391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.148633 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.148805 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.148968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.149128 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.149128 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.149535 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.149694 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.149861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.150027 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.150195 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.150356 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.150521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.150521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.150822 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.150975 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.151136 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.151290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.151441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.151592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.151742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.151742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.152057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.152219 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.152386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.152556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.152714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.152884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.153076 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.153238 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.153393 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.153544 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.153694 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.153858 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.154021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.154786 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.154950 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.155106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.155258 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.155419 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.155580 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.155743 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.155897 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.156168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.156337 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.156510 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.156682 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.156859 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.157021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.157175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.157335 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.157489 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.157655 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.157816 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.157977 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.158132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.158292 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.158446 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.158608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.158773 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.158933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.159097 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.159259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.159259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.159669 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.159669 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.159995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.160148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.160308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.160531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.160698 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.160862 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.161015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.161015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.161303 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.161467 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.161673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.161843 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.161843 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.162133 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.162293 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.162460 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.162620 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.162793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.162953 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.163105 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.163105 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.163407 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.163566 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.163718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.163878 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.164031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.164192 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.164344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.164516 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.164687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.164853 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.165006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.165167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.165328 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.165490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.165651 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.165812 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.165979 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.166150 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.166404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.166572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.166733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.166894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.167077 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.167232 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.167420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.167578 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.167729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.167880 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.168262 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.168434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.169119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.169277 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.169430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.169593 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.169873 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.170186 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.170347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.170505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.170658 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.170844 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.171048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.171246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.171398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.171550 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.171711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.171875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.172035 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.172200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.172200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.172509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.172670 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.172906 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.173060 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.173213 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.173372 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.173525 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.173525 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.173525 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.173525 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.174113 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.174276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.174436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.174603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.174764 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.174917 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.175068 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.175219 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.175377 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.175544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.175703 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.175853 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.176007 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.176159 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.176329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.176621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.176793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.176955 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.177109 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.177261 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.177413 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.177579 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.177747 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.177907 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.178069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.178229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.178402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.178556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.178708 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.178868 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.179028 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.179193 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.179362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.179524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.179677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.179863 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.180094 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.180254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.180427 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.180664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.180818 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.180969 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.181120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.181272 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.181441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.181606 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.181759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.181910 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.181910 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.182214 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.182368 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.182519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.182688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.182848 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.183000 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.183165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.183389 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.183546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.183698 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.183856 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.184009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.184196 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.184397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.184615 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.184725 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.184857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.184969 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.185067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.185679 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.185782 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.185862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.185935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186218 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186289 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186360 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186536 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186610 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186610 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186739 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186847 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.186937 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187091 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187245 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187421 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187421 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187570 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187570 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187719 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187805 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.187958 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188046 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188128 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188362 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188568 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188814 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188888 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.188960 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189030 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189193 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189418 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189489 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.189639 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.191420 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.191518 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.191518 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.191651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.191722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.191825 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.191914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.191998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192176 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192371 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.192908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.193038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.193444 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.193552 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.193639 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.193714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.193792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.193877 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.194115 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.194228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.194466 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.194780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.196508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.196638 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.196738 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.196738 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.196961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197041 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197323 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197407 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197481 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197552 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197700 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197787 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.197953 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.198057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.198259 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.198406 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.198572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.198757 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.198892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.199092 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.199209 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.199436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.199539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.199769 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.199894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.200143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.200236 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.200454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.200593 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.200792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.200946 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.201106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.201293 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.201424 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.201626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.201772 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.201949 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.202098 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.202272 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.202414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.202602 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.202739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.202921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.203063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.203254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.203396 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.203576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.203726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.203897 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.204038 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.204224 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.204364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.204564 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.204702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.204892 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.205033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.205208 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.205356 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.205524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.205658 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.205861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.206016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.206174 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.206316 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.206488 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.206603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.206802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.206906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.207121 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.207234 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.207439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.207534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.207760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.207853 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.208067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.208170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.208382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.208489 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.208729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.208836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.209046 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.209141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.209365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.209466 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.209678 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.209780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.210007 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.210104 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.210333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.210661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.210901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.211002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.211246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.211341 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.211595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.211704 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.211906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.212058 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.212223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.212360 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.212559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.212698 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.212878 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.213027 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.213194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.213338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.213516 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.213653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.213831 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.213980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.214149 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.214292 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.214473 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.214615 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.214793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.214930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.215123 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.215255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.215959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.216099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.216380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.216546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.216672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.216815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.216951 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.217083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.217313 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.217457 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.217590 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.217722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.217934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.218080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.218270 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.218414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.218593 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.218729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.218913 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.219064 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.219227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.219370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.219510 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:08:08.219674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.220002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.220325 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.220673 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.220995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.221314 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.221644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.221964 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.222550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.222876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.223202 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.223542 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.223880 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.224201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.224559 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.224901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.225262 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.225585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.225943 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.226288 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.226612 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.226933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.227247 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:08:08.227498 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117857) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:08:08.280887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Registered counter for database nova_api Aug 01 14:08:08.289105 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO dbcounter [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Registered counter for database nova_api Aug 01 14:08:08.301457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:08:08.308217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:08:08.309706 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_db.sqlalchemy.engines [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:08:08.316187 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writer thread running {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:08:08.363520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.context [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c66651a9-c088-4404-8a00-ed3d7b34326a(cell1) {{(pid=117859) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:08:08.367608 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:08.370246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:08.371043 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:08.372892 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.context [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c66651a9-c088-4404-8a00-ed3d7b34326a(cell1) {{(pid=117857) load_cells /opt/stack/nova/nova/context.py:464}} Aug 01 14:08:08.373112 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:08.375077 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Registered counter for database nova_cell0 Aug 01 14:08:08.377003 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:08.379169 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Registered counter for database nova_cell1 Aug 01 14:08:08.379486 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:08.380284 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:08:08.382331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:08:08.384316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO dbcounter [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Registered counter for database nova_cell0 Aug 01 14:08:08.386200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:08:08.387594 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:08:08.388666 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO dbcounter [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Registered counter for database nova_cell1 Aug 01 14:08:08.394363 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:08:08.395657 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:08:08.395945 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_db.sqlalchemy.engines [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:08:08.398057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_db.sqlalchemy.engines [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:08:08.404878 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writer thread running {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:08:08.406179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writer thread running {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:08:08.541070 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Registered counter for database nova_cell0 Aug 01 14:08:08.548366 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:08:08.552862 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:08:08.554201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO dbcounter [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Registered counter for database nova_cell0 Aug 01 14:08:08.560784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_db.sqlalchemy.engines [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117857) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:08:08.565209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writer thread running {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:08:08.873506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:08:08.880923 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:08:08.885112 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: WARNING keystonemiddleware.auth_token [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:08:08.893063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: WARNING keystonemiddleware.auth_token [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:08:09.224820 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:08:09.230845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-0a39e86d-af6a-45d9-be6b-c11263922c91 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:08:09.236996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b66d7529c0 pid: 117859 (default app) Aug 01 14:08:09.240021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: WARNING keystonemiddleware.auth_token [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 01 14:08:09.246118 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: WARNING keystonemiddleware.auth_token [None req-638156f5-61f6-4602-bce9-ac499e421369 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 01 14:08:09.251468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b66d7529c0 pid: 117857 (default app) Aug 01 14:08:51.145046 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:51.146156 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:51.146879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:51.149936 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:52.985313 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4801a3d6-c824-4992-9ba5-b1e1abe45835 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Action: 'create', calling method: .version_select at 0x7f4468e7cee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1445574465", "metadata": {"Type": "work"}}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:08:54.580933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=3 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.582120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=3 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.588254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=3 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.597794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=3 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.761406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4801a3d6-c824-4992-9ba5-b1e1abe45835 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.636833 Aug 01 14:08:54.762337 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 14:08:51 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3640 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 14:08:54.789906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a1d52273-bd00-4b0f-b43c-e330e3fafa12 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c63d30>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:54.925089 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a1d52273-bd00-4b0f-b43c-e330e3fafa12 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.148881 Aug 01 14:08:54.927412 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 2/2] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:54 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:55.244845 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7a8ba0b3-713c-4d42-ba81-a1b3ed354e0e tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f4468dd7a60>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:55.651772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7a8ba0b3-713c-4d42-ba81-a1b3ed354e0e tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/dea7bf30-d4d9-4ff9-ad04-2c2cecebf536" status: 200 len: 351 microversion: 2.1 time: 1.084585 Aug 01 14:08:55.652373 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 1/3] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:54 2022] GET /compute/v2.1/os-volumes/dea7bf30-d4d9-4ff9-ad04-2c2cecebf536 => generated 351 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:55.942129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b32b6452-1ff8-43cc-98cd-446a379a6b40 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c74430>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:56.096925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b32b6452-1ff8-43cc-98cd-446a379a6b40 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 354 microversion: 2.1 time: 0.159389 Aug 01 14:08:56.098947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:55 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 354 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:56.113017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2f06c818-ad10-4802-99c0-3f06678667e5 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c9bd30>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:56.627638 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2f06c818-ad10-4802-99c0-3f06678667e5 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 354 microversion: 2.1 time: 0.519679 Aug 01 14:08:56.628386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 2/5] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:56 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 354 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:56.644532 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6119d3ea-b74f-498f-b59a-9884ba744eaf tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c74af0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:56.769531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6119d3ea-b74f-498f-b59a-9884ba744eaf tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 202 len: 0 microversion: 2.1 time: 0.128664 Aug 01 14:08:56.770357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 4/6] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:08:56 2022] DELETE /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:08:56.779007 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0cc3f632-b23c-47f9-a02f-3dbe9eee5c84 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c574c0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:56.866826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0cc3f632-b23c-47f9-a02f-3dbe9eee5c84 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.092358 Aug 01 14:08:56.867338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:56 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:57.625269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b720b2ed-aaeb-44d7-96b8-ba5c9bdb31e4 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f4468c63d30>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:57.855560 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b720b2ed-aaeb-44d7-96b8-ba5c9bdb31e4 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1fcfe277-8e41-4a6c-af36-09195040c1dc" status: 200 len: 351 microversion: 2.1 time: 0.233596 Aug 01 14:08:57.856944 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:57 2022] GET /compute/v2.1/os-volumes/1fcfe277-8e41-4a6c-af36-09195040c1dc => generated 351 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:08:57.880648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-00a25710-fdc2-4d8b-af2d-7559eb16b837 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c57b80>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:57.960572 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-00a25710-fdc2-4d8b-af2d-7559eb16b837 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.083368 Aug 01 14:08:57.962419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 4/9] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:57 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:08:58.976537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d2bae9f3-f64a-401d-a4cf-6d5d62836038 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c74820>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:08:59.076213 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d2bae9f3-f64a-401d-a4cf-6d5d62836038 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.103535 Aug 01 14:08:59.077251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 6/10] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:08:58 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:00.090972 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-892b87b6-36ea-4898-9264-c1bd449172a9 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c9bca0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:00.208527 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-892b87b6-36ea-4898-9264-c1bd449172a9 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.122130 Aug 01 14:09:00.215391 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 5/11] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:00 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:01.223353 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2c867834-3064-4ede-8eb5-3a5728325346 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c74160>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:01.323279 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2c867834-3064-4ede-8eb5-3a5728325346 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.103612 Aug 01 14:09:01.330067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 7/12] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:01 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:02.341460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ac1aa4e9-98c3-4173-88a9-27cb9ade308a tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c57a60>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:02.476948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ac1aa4e9-98c3-4173-88a9-27cb9ade308a tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.139291 Aug 01 14:09:02.478014 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 6/13] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:02 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:02.849906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1177749538", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "networks": [{"uuid": "6abcd104-68ce-496b-89bd-593204dd6739"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:02.999765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] validate_networks() for [('6abcd104-68ce-496b-89bd-593204dd6739', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:09:03.491160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ab3d930b-44d2-48e7-bf2a-ced2bf6e119c tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468c573a0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:03.614759 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ab3d930b-44d2-48e7-bf2a-ced2bf6e119c tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.127390 Aug 01 14:09:03.615330 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 7/14] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:03 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:03.949240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a69f398c-4795-406b-adaa-881912a39203 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: .version_select at 0x7f4468c9bdc0>, body: {"keypair": {"name": "tempest-keypair-510544960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA4cFKNuopw6+6kC2RX6KhVlmH0e8f4v6AOdYECiIH6s2h+ZTdqlx5AQLZ2JCeNy+otznlR2smpJX0f/OupnRqjExpkVqz69zjNtlPkce76w4RoKkPCXhRzHLTgaiwGoug=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:04.074323 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-a69f398c-4795-406b-adaa-881912a39203 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for project a3203f080a05422e83090a1f0a31d1a9. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:09:04.091695 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-a69f398c-4795-406b-adaa-881912a39203 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for user ca3cd1c2aec94b43aff0034b812a069d and project a3203f080a05422e83090a1f0a31d1a9. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:09:04.225520 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a69f398c-4795-406b-adaa-881912a39203 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.380579 Aug 01 14:09:04.229619 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 8/15] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:09:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:04.371447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1288268103", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:04.660500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] validate_networks() for [('f97ce0db-2b99-49a1-bd13-dbbdc6c7df23', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:09:05.140809 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:09:05.142432 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:09:05.143133 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:09:05.143759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:09:05.144362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:09:05.161065 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:05.161868 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:05.171204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:05.171883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:05.213019 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Getting quotas for project c68666a08e3142de947cfa44ec5816a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:09:05.220977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Getting quotas for user 822ea58eeb4e4d29b132964c0e3355db and project c68666a08e3142de947cfa44ec5816a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:09:05.237538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:09:05.248311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:09:05.356296 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bb7f8b1c-713b-45c0-b92e-1ea5c5ae5a93 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.639746 Aug 01 14:09:05.356990 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 8/16] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:09:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:09:05.367863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-82b76719-ab81-4aca-8fed-9b4d459a468d tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468b79a60>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:05.492938 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-82b76719-ab81-4aca-8fed-9b4d459a468d tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.133539 Aug 01 14:09:05.499407 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 9/17] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:05 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:05.515102 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b28b41e6-68ad-4d4b-bd0c-29f37ee57aeb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:05.515688 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b28b41e6-68ad-4d4b-bd0c-29f37ee57aeb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:05.723363 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b28b41e6-68ad-4d4b-bd0c-29f37ee57aeb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:05.755501 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b28b41e6-68ad-4d4b-bd0c-29f37ee57aeb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1215 microversion: 2.1 time: 0.249628 Aug 01 14:09:05.758460 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 10/18] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:05 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1215 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:06.511021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bd4d18f3-2170-4a75-97a1-66b78fdc1257 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468b798b0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:06.668949 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bd4d18f3-2170-4a75-97a1-66b78fdc1257 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.165171 Aug 01 14:09:06.669998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 11/19] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:06 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:06.781419 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e8e1bccf-e257-48d2-b8e2-f5bfd5539001 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:06.782607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e8e1bccf-e257-48d2-b8e2-f5bfd5539001 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:06.899187 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e8e1bccf-e257-48d2-b8e2-f5bfd5539001 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:06.916937 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e8e1bccf-e257-48d2-b8e2-f5bfd5539001 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1215 microversion: 2.1 time: 0.137592 Aug 01 14:09:06.918686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 12/20] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:06 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:07.295836 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:09:07.297506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:09:07.298304 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:09:07.299079 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:09:07.300961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:09:07.320804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:07.321653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:07.332050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:07.333140 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:07.378985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Getting quotas for project 670dbffe4aed43c6afc3899ff59b8040. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:09:07.384024 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Getting quotas for user f379b005418a4e399c3b72cbbef6e00d and project 670dbffe4aed43c6afc3899ff59b8040. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:09:07.401177 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:09:07.404884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:09:07.562815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8cb776f6-3d62-41f6-b2e5-2ea4d4fa4893 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.329542 Aug 01 14:09:07.563463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 9/21] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:09:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 3331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:09:07.575892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-55093bc8-8d25-49e8-94e8-600153092d90 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:07.577271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-55093bc8-8d25-49e8-94e8-600153092d90 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:07.691983 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e725aeff-0f44-40b7-86a4-ce15699dd0a7 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f446837bf70>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:07.818570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e725aeff-0f44-40b7-86a4-ce15699dd0a7 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.137976 Aug 01 14:09:07.819687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 10/22] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:07 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:07.836652 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-55093bc8-8d25-49e8-94e8-600153092d90 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:07.845893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-55093bc8-8d25-49e8-94e8-600153092d90 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1222 microversion: 2.1 time: 0.274355 Aug 01 14:09:07.849116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 13/23] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:07 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1222 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:07.927129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-853382318", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:07.952234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f0a92aa9-d559-433d-9e87-64c2de5b46d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'create', calling method: .version_select at 0x7f446832d670>, body: {"keypair": {"name": "tempest-keypair-1751897942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN96blclBIfO6EUkT45XiyTvOcKQFNKq5ZoQ8mzkPz4PFcDhY80x5Ln3FYNy24PZZas9mWFZEhJbHkd3/KojEhMiKLIPh4vfevdTYsM63sl5GM8oDfHMXZ8CZg3a6yD2lA=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:07.999268 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-f0a92aa9-d559-433d-9e87-64c2de5b46d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Getting quotas for project 6d4402cabc4b41e0aec0ccc40cdd17cc. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:09:08.004933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-f0a92aa9-d559-433d-9e87-64c2de5b46d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Getting quotas for user 62cc969defd64837a20e9a7dbda5b4fa and project 6d4402cabc4b41e0aec0ccc40cdd17cc. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:09:08.078824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] validate_networks() for [('f97ce0db-2b99-49a1-bd13-dbbdc6c7df23', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:09:08.172398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f0a92aa9-d559-433d-9e87-64c2de5b46d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.352036 Aug 01 14:09:08.173708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 11/24] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Aug 1 14:09:07 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 354 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:08.179139 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7d7339d1-1d30-4578-9dd5-53144d7fc3c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:08.180181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7d7339d1-1d30-4578-9dd5-53144d7fc3c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:08.203840 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7d7339d1-1d30-4578-9dd5-53144d7fc3c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:08.204649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7d7339d1-1d30-4578-9dd5-53144d7fc3c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:08.205826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7d7339d1-1d30-4578-9dd5-53144d7fc3c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:08.207188 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7d7339d1-1d30-4578-9dd5-53144d7fc3c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:08.492399 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7d7339d1-1d30-4578-9dd5-53144d7fc3c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:08.523676 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7d7339d1-1d30-4578-9dd5-53144d7fc3c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1267 microversion: 2.1 time: 0.348764 Aug 01 14:09:08.525986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 12/25] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:08 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1267 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:08.832903 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7eaa044a-1082-41cb-9423-c662011b0c9b tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f44682bd3a0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:08.954925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7eaa044a-1082-41cb-9423-c662011b0c9b tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.125722 Aug 01 14:09:08.956018 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 13/26] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:08 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:08.965780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-680845788", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "953311ac-9b59-429f-b3be-74acb6dca2d9"}], "security_groups": [{"name": "tempest-securitygroup--1836389565"}], "key_name": "tempest-keypair-510544960", "user_data": "}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:09.220606 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] validate_networks() for [('953311ac-9b59-429f-b3be-74acb6dca2d9', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:09:09.516428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:09:09.519716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:09:09.520675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:09:09.521099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:09:09.521633 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:09:09.532654 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.533148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.534161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.534935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.571100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Getting quotas for project 670dbffe4aed43c6afc3899ff59b8040. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:09:09.576767 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Getting quotas for user f379b005418a4e399c3b72cbbef6e00d and project 670dbffe4aed43c6afc3899ff59b8040. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:09:09.609998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:09:09.612893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:09:09.687262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c60d7f6b-2494-4752-be50-9a6d368e0e50 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.767867 Aug 01 14:09:09.694351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 14/27] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:09:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 1776 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:09:09.700697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-def98dc0-9d8f-4d2a-81cf-bb8d3f6287ad tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:09.701560 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-def98dc0-9d8f-4d2a-81cf-bb8d3f6287ad tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:09.710531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-def98dc0-9d8f-4d2a-81cf-bb8d3f6287ad tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.711442 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-def98dc0-9d8f-4d2a-81cf-bb8d3f6287ad tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:09.713283 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-def98dc0-9d8f-4d2a-81cf-bb8d3f6287ad tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:09.713969 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-def98dc0-9d8f-4d2a-81cf-bb8d3f6287ad tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:10.032176 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-def98dc0-9d8f-4d2a-81cf-bb8d3f6287ad tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:10.068666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-def98dc0-9d8f-4d2a-81cf-bb8d3f6287ad tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1267 microversion: 2.1 time: 0.371006 Aug 01 14:09:10.072880 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 15/28] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:09 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1267 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:10.079111 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-75529fef-800b-419e-9973-7c0bdf848336 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:10.079945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-75529fef-800b-419e-9973-7c0bdf848336 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:10.200228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-75529fef-800b-419e-9973-7c0bdf848336 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:10.213161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-75529fef-800b-419e-9973-7c0bdf848336 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1221 microversion: 2.1 time: 0.138554 Aug 01 14:09:10.214343 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 16/29] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:10 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1221 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:10.220389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-72e9c61a-22f8-46f2-bda9-a87e0dd29c68 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468264700>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:10.394328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-72e9c61a-22f8-46f2-bda9-a87e0dd29c68 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.178596 Aug 01 14:09:10.402533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 17/30] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:10 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:10.875544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:09:10.876147 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:09:10.876514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:09:10.876946 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:09:10.877365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:09:10.900088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:10.900578 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:10.901393 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:10.901834 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:10.935066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for project a3203f080a05422e83090a1f0a31d1a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:09:10.939512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for user ca3cd1c2aec94b43aff0034b812a069d and project a3203f080a05422e83090a1f0a31d1a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:09:10.952259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:09:10.954839 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:09:11.035194 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-af50ba6e-9141-4900-bbb6-ae5d7a219b87 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.077884 Aug 01 14:09:11.036420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 14/31] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:09:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 2080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:09:11.048100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ef2b58d6-f6e9-42aa-a7b1-a1c7758bf7af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:11.049418 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ef2b58d6-f6e9-42aa-a7b1-a1c7758bf7af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:11.101074 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b2baf2e7-bbee-4313-8611-11bba289aa92 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:11.101731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b2baf2e7-bbee-4313-8611-11bba289aa92 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:11.128514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b2baf2e7-bbee-4313-8611-11bba289aa92 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:11.129166 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b2baf2e7-bbee-4313-8611-11bba289aa92 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:11.130347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b2baf2e7-bbee-4313-8611-11bba289aa92 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:11.130954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b2baf2e7-bbee-4313-8611-11bba289aa92 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:11.157122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ef2b58d6-f6e9-42aa-a7b1-a1c7758bf7af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:11.165256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ef2b58d6-f6e9-42aa-a7b1-a1c7758bf7af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1240 microversion: 2.1 time: 0.121389 Aug 01 14:09:11.169389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 18/32] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:11 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1240 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:11.234414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-573a497d-d47d-4b61-b450-eb695715e2a5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:11.237466 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-573a497d-d47d-4b61-b450-eb695715e2a5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:11.253780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-573a497d-d47d-4b61-b450-eb695715e2a5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:11.254358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-573a497d-d47d-4b61-b450-eb695715e2a5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:11.255256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-573a497d-d47d-4b61-b450-eb695715e2a5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:11.257139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-573a497d-d47d-4b61-b450-eb695715e2a5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:11.299691 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b2baf2e7-bbee-4313-8611-11bba289aa92 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:11.313519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b2baf2e7-bbee-4313-8611-11bba289aa92 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1267 microversion: 2.1 time: 0.221042 Aug 01 14:09:11.324644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 15/33] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:11 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1267 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:11.406004 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-573a497d-d47d-4b61-b450-eb695715e2a5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:11.409116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-57bd6a9c-a2de-4e49-9640-c257c8777655 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f44682803a0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:11.417041 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-573a497d-d47d-4b61-b450-eb695715e2a5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1225 microversion: 2.1 time: 0.186473 Aug 01 14:09:11.430260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 19/34] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:11 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1225 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:11.469620 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-57bd6a9c-a2de-4e49-9640-c257c8777655 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.064564 Aug 01 14:09:11.470803 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 16/35] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:11 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:11.607659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1709138457", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb61fa02-09d7-4db2-9187-e0278beee81d"}], "security_groups": [{"name": "tempest-securitygroup--260141863"}], "key_name": "tempest-keypair-1751897942", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:11.747294 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] validate_networks() for [('bb61fa02-09d7-4db2-9187-e0278beee81d', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:09:12.118950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:09:12.119849 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:09:12.120043 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:09:12.120470 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:09:12.120925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:09:12.131749 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.132384 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.133696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.134138 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.156532 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Getting quotas for project 6d4402cabc4b41e0aec0ccc40cdd17cc. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:09:12.162139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Getting quotas for user 62cc969defd64837a20e9a7dbda5b4fa and project 6d4402cabc4b41e0aec0ccc40cdd17cc. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:09:12.179128 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:09:12.183236 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:09:12.192001 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9e7979f2-eb2a-49d9-b042-dcbef9070ef0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:12.193352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9e7979f2-eb2a-49d9-b042-dcbef9070ef0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:12.200394 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e7979f2-eb2a-49d9-b042-dcbef9070ef0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.201353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e7979f2-eb2a-49d9-b042-dcbef9070ef0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.202800 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e7979f2-eb2a-49d9-b042-dcbef9070ef0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.203448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e7979f2-eb2a-49d9-b042-dcbef9070ef0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.306308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9e7979f2-eb2a-49d9-b042-dcbef9070ef0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.316111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9e7979f2-eb2a-49d9-b042-dcbef9070ef0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1244 microversion: 2.1 time: 0.129210 Aug 01 14:09:12.316733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 17/36] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:12 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1244 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:12.340815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e732e627-cdef-4f08-a494-ad4efd7d369c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:12.341437 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e732e627-cdef-4f08-a494-ad4efd7d369c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:12.346070 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ca76e202-c150-4a13-99d2-1b4e9e5c2755 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.745747 Aug 01 14:09:12.356778 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 20/37] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Aug 1 14:09:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 14:09:12.374754 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-17a7c66f-8b17-4edd-a56c-3208f42bfcc5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:12.376990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e732e627-cdef-4f08-a494-ad4efd7d369c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.377438 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e732e627-cdef-4f08-a494-ad4efd7d369c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.378223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e732e627-cdef-4f08-a494-ad4efd7d369c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.378657 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e732e627-cdef-4f08-a494-ad4efd7d369c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.382620 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-17a7c66f-8b17-4edd-a56c-3208f42bfcc5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:12.556872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e732e627-cdef-4f08-a494-ad4efd7d369c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.567596 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e732e627-cdef-4f08-a494-ad4efd7d369c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1275 microversion: 2.1 time: 0.232738 Aug 01 14:09:12.568290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 18/38] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:12 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:12.575604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7f349a2a-242a-4f40-b38a-58a816114522 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:12.576439 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7f349a2a-242a-4f40-b38a-58a816114522 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:12.588972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-17a7c66f-8b17-4edd-a56c-3208f42bfcc5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.601496 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f349a2a-242a-4f40-b38a-58a816114522 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.602432 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-17a7c66f-8b17-4edd-a56c-3208f42bfcc5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.605561 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f349a2a-242a-4f40-b38a-58a816114522 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.608104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-17a7c66f-8b17-4edd-a56c-3208f42bfcc5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.609283 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-17a7c66f-8b17-4edd-a56c-3208f42bfcc5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1282 microversion: 2.20 time: 0.251657 Aug 01 14:09:12.610670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f349a2a-242a-4f40-b38a-58a816114522 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:12.611181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f349a2a-242a-4f40-b38a-58a816114522 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:12.613421 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 21/39] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:12 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1282 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:12.640660 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-44a1a9aa-eeef-47cd-9e26-59737d1219c5 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f4468271dc0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:12.760997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-44a1a9aa-eeef-47cd-9e26-59737d1219c5 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.134268 Aug 01 14:09:12.761730 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 22/40] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:12 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:12.801276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7f349a2a-242a-4f40-b38a-58a816114522 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:12.810852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7f349a2a-242a-4f40-b38a-58a816114522 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1217 microversion: 2.1 time: 0.240094 Aug 01 14:09:12.812167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 19/41] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:12 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1217 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:13.343333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-16f8a924-37e3-40e9-bb57-ccd102fe7c9c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.347385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-16f8a924-37e3-40e9-bb57-ccd102fe7c9c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:13.366183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16f8a924-37e3-40e9-bb57-ccd102fe7c9c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.367303 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16f8a924-37e3-40e9-bb57-ccd102fe7c9c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.371213 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16f8a924-37e3-40e9-bb57-ccd102fe7c9c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.371755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16f8a924-37e3-40e9-bb57-ccd102fe7c9c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.488691 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-16f8a924-37e3-40e9-bb57-ccd102fe7c9c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.497898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-16f8a924-37e3-40e9-bb57-ccd102fe7c9c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1292 microversion: 2.1 time: 0.158365 Aug 01 14:09:13.499074 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 23/42] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1292 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:13.592687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d86be061-0ab8-4666-83a3-eff7b4fb7dbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.593308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d86be061-0ab8-4666-83a3-eff7b4fb7dbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:13.610339 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d86be061-0ab8-4666-83a3-eff7b4fb7dbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.610800 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d86be061-0ab8-4666-83a3-eff7b4fb7dbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.611740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d86be061-0ab8-4666-83a3-eff7b4fb7dbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.612181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d86be061-0ab8-4666-83a3-eff7b4fb7dbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.639326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.639855 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:13.648269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.648999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.650488 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.651674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.687344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d86be061-0ab8-4666-83a3-eff7b4fb7dbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.695438 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d86be061-0ab8-4666-83a3-eff7b4fb7dbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1273 microversion: 2.1 time: 0.106642 Aug 01 14:09:13.696130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 20/43] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:13.729299 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.737259 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.739037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.740203 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a721b739-d44f-43e3-a7c7-7f4adb9d2cba tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1278 microversion: 2.20 time: 0.105642 Aug 01 14:09:13.740838 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 24/44] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1278 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:13.776856 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8b19dd1e-b83e-4b82-9cb0-6f04009670f9 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f446823c430>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.832622 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc4bce6d-3452-490a-b4e0-fe359f0fe8be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.833244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fc4bce6d-3452-490a-b4e0-fe359f0fe8be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:13.845365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8b19dd1e-b83e-4b82-9cb0-6f04009670f9 tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 200 len: 353 microversion: 2.1 time: 0.073920 Aug 01 14:09:13.851871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 21/45] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 353 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:13.868061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc4bce6d-3452-490a-b4e0-fe359f0fe8be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.880612 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc4bce6d-3452-490a-b4e0-fe359f0fe8be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.880612 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc4bce6d-3452-490a-b4e0-fe359f0fe8be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:13.903990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4a157b85-616f-4392-92f1-65f1b4b58018 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f44682bdf70>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:13.907230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc4bce6d-3452-490a-b4e0-fe359f0fe8be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:13.989480 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fc4bce6d-3452-490a-b4e0-fe359f0fe8be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:13.998147 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4a157b85-616f-4392-92f1-65f1b4b58018 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8d76d3e3-1e3b-4e8c-aa62-e98d3cddfdbd" status: 200 len: 350 microversion: 2.1 time: 0.144009 Aug 01 14:09:13.998502 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fc4bce6d-3452-490a-b4e0-fe359f0fe8be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1273 microversion: 2.1 time: 0.169593 Aug 01 14:09:13.998890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 22/46] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/os-volumes/8d76d3e3-1e3b-4e8c-aa62-e98d3cddfdbd => generated 350 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:13.999467 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 25/47] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:13 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1273 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:14.017416 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-902535e0-b4f6-4860-bf27-31178afc1a33 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f4468221550>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.192631 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-902535e0-b4f6-4860-bf27-31178afc1a33 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.178374 Aug 01 14:09:14.193455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 23/48] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:14.211336 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-70c78e6b-4bbf-44f2-91f7-4dd3195d3e89 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f44682c2c10>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.477416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-70c78e6b-4bbf-44f2-91f7-4dd3195d3e89 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.272304 Aug 01 14:09:14.478836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 26/49] 10.222.0.48 () {58 vars in 1149 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:14.507688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-302b06ed-0c0f-4531-ab08-ea678e282261 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f44695e6430>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.526327 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e8c3e7cb-cf45-4c06-99ec-c1f0eec4c225 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.527379 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e8c3e7cb-cf45-4c06-99ec-c1f0eec4c225 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:14.536005 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e8c3e7cb-cf45-4c06-99ec-c1f0eec4c225 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.537091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e8c3e7cb-cf45-4c06-99ec-c1f0eec4c225 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.538342 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e8c3e7cb-cf45-4c06-99ec-c1f0eec4c225 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.539029 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e8c3e7cb-cf45-4c06-99ec-c1f0eec4c225 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.793952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-302b06ed-0c0f-4531-ab08-ea678e282261 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.305457 Aug 01 14:09:14.795162 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 24/50] 10.222.0.48 () {58 vars in 1134 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:14.800930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9d7e2f76-b8ec-4277-afc3-5b0f08b1e631 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.801653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9d7e2f76-b8ec-4277-afc3-5b0f08b1e631 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:14.831510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9d7e2f76-b8ec-4277-afc3-5b0f08b1e631 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.832249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9d7e2f76-b8ec-4277-afc3-5b0f08b1e631 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.833384 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9d7e2f76-b8ec-4277-afc3-5b0f08b1e631 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.835934 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9d7e2f76-b8ec-4277-afc3-5b0f08b1e631 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.901925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e8c3e7cb-cf45-4c06-99ec-c1f0eec4c225 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:14.912267 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e8c3e7cb-cf45-4c06-99ec-c1f0eec4c225 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1310 microversion: 2.1 time: 0.396606 Aug 01 14:09:14.921265 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 27/51] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1310 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:14.931294 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:14.949959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:14.971664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.972123 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:14.973184 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:14.973508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:15.954406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:15.971052 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:15.975489 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:15.977717 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-87e593e4-98ed-4b54-bada-175e8cde1f6f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1334 microversion: 2.20 time: 1.055382 Aug 01 14:09:15.980845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 28/52] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1334 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:15.992436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-40da41b7-ab0d-4f42-8535-76894d62967d tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f4468271a60>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:16.112852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9d7e2f76-b8ec-4277-afc3-5b0f08b1e631 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:16.125738 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9d7e2f76-b8ec-4277-afc3-5b0f08b1e631 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 1.329314 Aug 01 14:09:16.126317 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 25/53] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:14 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:16.130918 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-deb3a00d-b440-40f9-af11-23269de8e8bc tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Calling method '.version_select at 0x7f44682213a0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:16.213318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-deb3a00d-b440-40f9-af11-23269de8e8bc tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] HTTP exception thrown: Volume 1e42cbcd-104f-48c9-a75f-e7e4995826f6 could not be found. Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-deb3a00d-b440-40f9-af11-23269de8e8bc tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Request method failure captured: Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 HTTP/1.1 Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595zLLL16D7so9gpszF6TDshHvJrKFgK-J5-TOzvG_a5aUlE2l0YyyclhdRjdA63DDTWwaFY_zNpUECO-snOjRKNs9k1QLb8JMUId1FEQ6WJC8FgeU_acg-KTmE886sa2N-ZSd5DhkO7vUhznVHpStDnbXUVAtHPG8YjNH2RtfKe7RE Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 20a0f7842ef749f38d4bdf536f75d993 Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-VolumesGetTestJSON-1740523847 Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:09:16.217405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/20a0f7842ef749f38d4bdf536f75d993"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20a0f7842ef749f38d4bdf536f75d993"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_20a0f7842ef749f38d4bdf536f75d993"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/20a0f7842ef749f38d4bdf536f75d993"}]}] Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-VolumesGetTestJSON-1740523847 Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 20a0f7842ef749f38d4bdf536f75d993 Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-VolumesGetTestJSON-1740523847 Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-VolumesGetTestJSON-1740523847-project Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 9c968d77125448a7860a47707224e1a4 Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-VolumesGetTestJSON-1740523847-project Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Volume 1e42cbcd-104f-48c9-a75f-e7e4995826f6 could not be found. Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '1e42cbcd-104f-48c9-a75f-e7e4995826f6'} Aug 01 14:09:16.219404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1e42cbcd-104f-48c9-a75f-e7e4995826f6 could not be found. (HTTP 404) (Request-ID: req-e90a1988-511a-4ea1-9967-f1998cbbaa5a) Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:16.220746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:09:16.221826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1e42cbcd-104f-48c9-a75f-e7e4995826f6 could not be found. Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:09:16.224636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1e42cbcd-104f-48c9-a75f-e7e4995826f6 could not be found. Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1e42cbcd-104f-48c9-a75f-e7e4995826f6 could not be found. Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-deb3a00d-b440-40f9-af11-23269de8e8bc tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] Returning 404 to user: Volume 1e42cbcd-104f-48c9-a75f-e7e4995826f6 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-deb3a00d-b440-40f9-af11-23269de8e8bc tempest-VolumesGetTestJSON-1740523847 tempest-VolumesGetTestJSON-1740523847-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6" status: 404 len: 109 microversion: 2.1 time: 0.091449 Aug 01 14:09:16.226827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 26/54] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:16 2022] GET /compute/v2.1/os-volumes/1e42cbcd-104f-48c9-a75f-e7e4995826f6 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:09:16.236927 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-40da41b7-ab0d-4f42-8535-76894d62967d tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.238043 Aug 01 14:09:16.236927 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 29/55] 10.222.0.48 () {58 vars in 1167 bytes} [Mon Aug 1 14:09:15 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:16.242169 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-00b83ad0-e917-4b9e-b581-43b35e19d1ea tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:16.242906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-00b83ad0-e917-4b9e-b581-43b35e19d1ea tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:16.246466 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-63dc4b34-6b84-4723-86ab-30e352c114ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:16.247221 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-63dc4b34-6b84-4723-86ab-30e352c114ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:16.260349 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63dc4b34-6b84-4723-86ab-30e352c114ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:16.262479 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00b83ad0-e917-4b9e-b581-43b35e19d1ea tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:16.263016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00b83ad0-e917-4b9e-b581-43b35e19d1ea tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:16.263891 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00b83ad0-e917-4b9e-b581-43b35e19d1ea tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:16.265919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00b83ad0-e917-4b9e-b581-43b35e19d1ea tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:16.269225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63dc4b34-6b84-4723-86ab-30e352c114ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:16.270173 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63dc4b34-6b84-4723-86ab-30e352c114ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:16.270637 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63dc4b34-6b84-4723-86ab-30e352c114ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:16.392428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-63dc4b34-6b84-4723-86ab-30e352c114ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:16.401986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-63dc4b34-6b84-4723-86ab-30e352c114ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1279 microversion: 2.1 time: 0.176455 Aug 01 14:09:16.408463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 27/56] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:16 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1279 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:16.411788 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-00b83ad0-e917-4b9e-b581-43b35e19d1ea tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:16.413365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-41a4381a-f142-464b-a108-f792799b5536 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f446823c790>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:16.428734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-00b83ad0-e917-4b9e-b581-43b35e19d1ea tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1298 microversion: 2.1 time: 0.198957 Aug 01 14:09:16.446206 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 30/57] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:16 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1298 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:16.660719 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-41a4381a-f142-464b-a108-f792799b5536 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.250835 Aug 01 14:09:16.661336 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 28/58] 10.222.0.48 () {58 vars in 1170 bytes} [Mon Aug 1 14:09:16 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:16.675873 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-63cdf32e-9e78-4705-a2da-9792771f17cf tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f44682ce3a0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:16.852217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-63cdf32e-9e78-4705-a2da-9792771f17cf tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.180274 Aug 01 14:09:16.853067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 31/59] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Aug 1 14:09:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:16.866737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9f7bad92-db81-477c-bfeb-9b84757facce tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f4468221dc0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.007244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.008677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:17.019630 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.026313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9f7bad92-db81-477c-bfeb-9b84757facce tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.163555 Aug 01 14:09:17.027546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 29/60] 10.222.0.48 () {58 vars in 1188 bytes} [Mon Aug 1 14:09:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:17.028057 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.029939 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.043823 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2c69497a-2d07-477c-94fc-1d45bddebb97 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] Calling method '.version_select at 0x7f44681cf940>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.046222 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.198557 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2c69497a-2d07-477c-94fc-1d45bddebb97 tempest-VolumesTestJSON-1258575748 tempest-VolumesTestJSON-1258575748-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.160961 Aug 01 14:09:17.199224 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 30/61] 10.222.0.48 () {58 vars in 1155 bytes} [Mon Aug 1 14:09:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:17.211006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-100959f3-acd2-4cc5-baab-2ef3b4dff3af tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.230204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:17.250804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-100959f3-acd2-4cc5-baab-2ef3b4dff3af tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:17.267071 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:17.280341 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:17.285861 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-935740f9-69e0-43de-b5cf-da1a5c788695 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1340 microversion: 2.20 time: 0.280364 Aug 01 14:09:17.288120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-100959f3-acd2-4cc5-baab-2ef3b4dff3af tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.288607 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-100959f3-acd2-4cc5-baab-2ef3b4dff3af tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.289413 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-100959f3-acd2-4cc5-baab-2ef3b4dff3af tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.290998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:17 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1340 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:17.298508 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-100959f3-acd2-4cc5-baab-2ef3b4dff3af tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.429906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-41c57e11-b57b-400f-9653-dea2de31ce92 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.431269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-41c57e11-b57b-400f-9653-dea2de31ce92 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:17.443311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41c57e11-b57b-400f-9653-dea2de31ce92 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.443768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41c57e11-b57b-400f-9653-dea2de31ce92 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.446108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41c57e11-b57b-400f-9653-dea2de31ce92 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.451988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41c57e11-b57b-400f-9653-dea2de31ce92 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.617347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-100959f3-acd2-4cc5-baab-2ef3b4dff3af tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:17.629254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-100959f3-acd2-4cc5-baab-2ef3b4dff3af tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.428565 Aug 01 14:09:17.629785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 31/63] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:17 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:17.636194 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-699c1340-dfec-48fb-8702-46af1c8817a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:17.639925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-699c1340-dfec-48fb-8702-46af1c8817a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:17.657405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-699c1340-dfec-48fb-8702-46af1c8817a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.660928 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-699c1340-dfec-48fb-8702-46af1c8817a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.661969 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-699c1340-dfec-48fb-8702-46af1c8817a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.662424 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-699c1340-dfec-48fb-8702-46af1c8817a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:17.712755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41c57e11-b57b-400f-9653-dea2de31ce92 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:17.722145 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-41c57e11-b57b-400f-9653-dea2de31ce92 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.297281 Aug 01 14:09:17.738801 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 33/64] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:17 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:17.777925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-699c1340-dfec-48fb-8702-46af1c8817a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:17.800466 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-699c1340-dfec-48fb-8702-46af1c8817a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1298 microversion: 2.1 time: 0.168328 Aug 01 14:09:17.813205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:17 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1298 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:17.973312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-75e59e90-b9c5-44b8-90ad-faf9dbfef984 req-aa494d59-dc5d-4971-9ac6-a3315db9eda0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "553535d2-88d8-4b52-910e-9e103d370fa3", "tag": "65e39196-7685-44bb-83da-d3a148812c3f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:17.987855 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-75e59e90-b9c5-44b8-90ad-faf9dbfef984 req-aa494d59-dc5d-4971-9ac6-a3315db9eda0 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:17.988562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-75e59e90-b9c5-44b8-90ad-faf9dbfef984 req-aa494d59-dc5d-4971-9ac6-a3315db9eda0 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.016021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-75e59e90-b9c5-44b8-90ad-faf9dbfef984 req-aa494d59-dc5d-4971-9ac6-a3315db9eda0 service nova] Creating event network-changed:65e39196-7685-44bb-83da-d3a148812c3f for instance 553535d2-88d8-4b52-910e-9e103d370fa3 on hv-cinder-84713 Aug 01 14:09:18.016773 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-75e59e90-b9c5-44b8-90ad-faf9dbfef984 req-aa494d59-dc5d-4971-9ac6-a3315db9eda0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 14:09:18.017659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6320164b-7460-40fe-a68d-b7d67c34e7da None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.019190 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6320164b-7460-40fe-a68d-b7d67c34e7da None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.020417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6320164b-7460-40fe-a68d-b7d67c34e7da None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.021135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6320164b-7460-40fe-a68d-b7d67c34e7da None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.032607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.compute.rpcapi [None req-6320164b-7460-40fe-a68d-b7d67c34e7da None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 14:09:18.033609 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6320164b-7460-40fe-a68d-b7d67c34e7da None None] Releasing lock "compute-rpcapi-router" {{(pid=117859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 14:09:18.059094 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6320164b-7460-40fe-a68d-b7d67c34e7da None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.318809 Aug 01 14:09:18.059718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 34/66] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:18.318167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:18.318780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:18.324949 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.325400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.326158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.326596 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.387374 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:18.395896 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:18.397483 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:18.398663 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-313b3154-0454-4d16-ad9b-0b0fa9b59e6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1340 microversion: 2.20 time: 0.084353 Aug 01 14:09:18.415890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:18 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:18.653849 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b4bd0665-ef6b-42e2-b1d8-98d2067f2877 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:18.655767 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b4bd0665-ef6b-42e2-b1d8-98d2067f2877 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:18.662315 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4bd0665-ef6b-42e2-b1d8-98d2067f2877 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.662942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4bd0665-ef6b-42e2-b1d8-98d2067f2877 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.663870 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4bd0665-ef6b-42e2-b1d8-98d2067f2877 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.664696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4bd0665-ef6b-42e2-b1d8-98d2067f2877 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.742792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9e16a73d-0208-4478-bce2-bf0f867b469f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:18.743455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9e16a73d-0208-4478-bce2-bf0f867b469f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:18.749762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e16a73d-0208-4478-bce2-bf0f867b469f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.750229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e16a73d-0208-4478-bce2-bf0f867b469f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.751004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e16a73d-0208-4478-bce2-bf0f867b469f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.751440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e16a73d-0208-4478-bce2-bf0f867b469f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.826689 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4bd0665-ef6b-42e2-b1d8-98d2067f2877 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:18.835440 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b4bd0665-ef6b-42e2-b1d8-98d2067f2877 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.188971 Aug 01 14:09:18.836529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 35/68] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:18 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:18.842963 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e70c6ced-8254-4adb-a08f-ac6a403ff8db tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:18.845169 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e70c6ced-8254-4adb-a08f-ac6a403ff8db tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:18.850812 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.860465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e70c6ced-8254-4adb-a08f-ac6a403ff8db tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.862300 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e70c6ced-8254-4adb-a08f-ac6a403ff8db tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.863337 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e70c6ced-8254-4adb-a08f-ac6a403ff8db tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:18.863844 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e70c6ced-8254-4adb-a08f-ac6a403ff8db tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:18.923944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9e16a73d-0208-4478-bce2-bf0f867b469f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:18.932143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9e16a73d-0208-4478-bce2-bf0f867b469f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.193122 Aug 01 14:09:18.932705 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 34/69] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:18 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:18.939302 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e70c6ced-8254-4adb-a08f-ac6a403ff8db tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:18.947243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e70c6ced-8254-4adb-a08f-ac6a403ff8db tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1298 microversion: 2.1 time: 0.108817 Aug 01 14:09:18.947813 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 36/70] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:18 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1298 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:19.180404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c60d425b-a6d9-4865-bb88-de65dbf3a9d6 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Action: 'create', calling method: .version_select at 0x7f4468221e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-739254462", "metadata": {"Type": "work"}}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c60d425b-a6d9-4865-bb88-de65dbf3a9d6 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Request method failure captured: Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 121 Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi596Oe0AMY_36g14Tb_0ldUz5BaWgQTrcurdT-zjioHvmZySKPnM78igxYeTRhcroQKBH1X6clJ4RLF7oCXCrURiSLBqRERbCpF_I2IR-O_rnXcaLXBu17kPfGtYtMoJde-6c4Pq6nSoYt0v3lPdTFlYNlENzcQPo2SrHuVMiHWcG7c4 Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:09:19.185998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}] Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: bce1abf62a5a4dfeaf704e18823c56dd Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-739254462", "metadata": {"Type": "work"}}} Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: Aug 01 14:09:19.187303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-739254462', 'metadata': {'Type': 'work'}}}} Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi '#$%' Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:19.188167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:09:19.194070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:09:19.195205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 01 14:09:19.195205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.195205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c60d425b-a6d9-4865-bb88-de65dbf3a9d6 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:19.195205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c60d425b-a6d9-4865-bb88-de65dbf3a9d6 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.253983 Aug 01 14:09:19.195205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 35/71] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 14:09:18 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:09:19.198720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7493aaa2-79aa-4380-8949-b65de4682fc9 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Action: 'create', calling method: .version_select at 0x7f4468213940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-655419554", "metadata": {"Type": "work"}}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7493aaa2-79aa-4380-8949-b65de4682fc9 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Request method failure captured: Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 119 Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi596Oe0AMY_36g14Tb_0ldUz5BaWgQTrcurdT-zjioHvmZySKPnM78igxYeTRhcroQKBH1X6clJ4RLF7oCXCrURiSLBqRERbCpF_I2IR-O_rnXcaLXBu17kPfGtYtMoJde-6c4Pq6nSoYt0v3lPdTFlYNlENzcQPo2SrHuVMiHWcG7c4 Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:09:19.204905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}] Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: bce1abf62a5a4dfeaf704e18823c56dd Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-655419554", "metadata": {"Type": "work"}}} Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: Aug 01 14:09:19.206271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-655419554', 'metadata': {'Type': 'work'}}}} Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi '0' Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:19.207091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:09:19.208132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:09:19.209171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 01 14:09:19.209171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.209171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7493aaa2-79aa-4380-8949-b65de4682fc9 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:19.209171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7493aaa2-79aa-4380-8949-b65de4682fc9 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012465 Aug 01 14:09:19.209171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 14:09:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:09:19.219690 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-efc899c2-8a9a-4148-8a17-755b068f2ed2 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Action: 'create', calling method: .version_select at 0x7f446828caf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1623295912", "metadata": {"Type": "work"}}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-efc899c2-8a9a-4148-8a17-755b068f2ed2 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Request method failure captured: Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 119 Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi596Oe0AMY_36g14Tb_0ldUz5BaWgQTrcurdT-zjioHvmZySKPnM78igxYeTRhcroQKBH1X6clJ4RLF7oCXCrURiSLBqRERbCpF_I2IR-O_rnXcaLXBu17kPfGtYtMoJde-6c4Pq6nSoYt0v3lPdTFlYNlENzcQPo2SrHuVMiHWcG7c4 Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:09:19.228886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}] Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: bce1abf62a5a4dfeaf704e18823c56dd Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1623295912", "metadata": {"Type": "work"}}} Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: Aug 01 14:09:19.230183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1623295912', 'metadata': {'Type': 'work'}}}} Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise error Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi '' Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:19.231015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 01 14:09:19.232364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 01 14:09:19.233509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 01 14:09:19.233509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.234002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-efc899c2-8a9a-4148-8a17-755b068f2ed2 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:19.235049 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-efc899c2-8a9a-4148-8a17-755b068f2ed2 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.020551 Aug 01 14:09:19.235600 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 36/73] 10.222.0.48 () {60 vars in 1156 bytes} [Mon Aug 1 14:09:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 14:09:19.247340 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92f39403-a953-4234-98ab-2c9d185496d3 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Calling method '.version_select at 0x7f44681ddd30>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:19.276413 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-92f39403-a953-4234-98ab-2c9d185496d3 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] HTTP exception thrown: Volume tempest-invalid-862722405 could not be found. Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92f39403-a953-4234-98ab-2c9d185496d3 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Request method failure captured: Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-862722405 HTTP/1.1 Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi596Oe0AMY_36g14Tb_0ldUz5BaWgQTrcurdT-zjioHvmZySKPnM78igxYeTRhcroQKBH1X6clJ4RLF7oCXCrURiSLBqRERbCpF_I2IR-O_rnXcaLXBu17kPfGtYtMoJde-6c4Pq6nSoYt0v3lPdTFlYNlENzcQPo2SrHuVMiHWcG7c4 Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:09:19.280023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}] Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: bce1abf62a5a4dfeaf704e18823c56dd Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Volume tempest-invalid-862722405 could not be found. Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'tempest-invalid-862722405'} Aug 01 14:09:19.281276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-862722405 could not be found. (HTTP 404) (Request-ID: req-649225c8-4f8a-4c8c-956f-ab3bdf2623e6) Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.281981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:09:19.282909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-862722405 could not be found. Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:09:19.283792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-862722405 could not be found. Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-862722405 could not be found. Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92f39403-a953-4234-98ab-2c9d185496d3 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Returning 404 to user: Volume tempest-invalid-862722405 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-92f39403-a953-4234-98ab-2c9d185496d3 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-862722405" status: 404 len: 98 microversion: 2.1 time: 0.040053 Aug 01 14:09:19.285416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 38/74] 10.222.0.48 () {58 vars in 1215 bytes} [Mon Aug 1 14:09:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-862722405 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:09:19.291553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-40044ed0-4a1c-4781-a364-01efd6f23d35 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004304 Aug 01 14:09:19.292338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 37/75] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Aug 1 14:09:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 01 14:09:19.300264 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-41b61a03-74cd-4bab-91f4-0408f833c339 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003666 Aug 01 14:09:19.300791 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 39/76] 10.222.0.48 () {58 vars in 1137 bytes} [Mon Aug 1 14:09:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 01 14:09:19.309884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d9d1188e-304d-4e9f-8829-be7fb3c5bb24 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Calling method '.version_select at 0x7f4468221ee0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:19.338548 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-d9d1188e-304d-4e9f-8829-be7fb3c5bb24 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] HTTP exception thrown: Volume 9bbc21ca-44dc-404e-82e1-941cbd4c334e could not be found. Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d9d1188e-304d-4e9f-8829-be7fb3c5bb24 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Request method failure captured: Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/os-volumes/9bbc21ca-44dc-404e-82e1-941cbd4c334e HTTP/1.1 Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi596Oe0AMY_36g14Tb_0ldUz5BaWgQTrcurdT-zjioHvmZySKPnM78igxYeTRhcroQKBH1X6clJ4RLF7oCXCrURiSLBqRERbCpF_I2IR-O_rnXcaLXBu17kPfGtYtMoJde-6c4Pq6nSoYt0v3lPdTFlYNlENzcQPo2SrHuVMiHWcG7c4 Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:09:19.340465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}] Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: bce1abf62a5a4dfeaf704e18823c56dd Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Volume 9bbc21ca-44dc-404e-82e1-941cbd4c334e could not be found. Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '9bbc21ca-44dc-404e-82e1-941cbd4c334e'} Aug 01 14:09:19.341714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9bbc21ca-44dc-404e-82e1-941cbd4c334e could not be found. (HTTP 404) (Request-ID: req-93db4980-ead9-4029-afcb-c98433d3377d) Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.342353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:09:19.343315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9bbc21ca-44dc-404e-82e1-941cbd4c334e could not be found. Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:09:19.344460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9bbc21ca-44dc-404e-82e1-941cbd4c334e could not be found. Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9bbc21ca-44dc-404e-82e1-941cbd4c334e could not be found. Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d9d1188e-304d-4e9f-8829-be7fb3c5bb24 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Returning 404 to user: Volume 9bbc21ca-44dc-404e-82e1-941cbd4c334e could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:19.345411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d9d1188e-304d-4e9f-8829-be7fb3c5bb24 tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/9bbc21ca-44dc-404e-82e1-941cbd4c334e" status: 404 len: 109 microversion: 2.1 time: 0.036417 Aug 01 14:09:19.348621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 38/77] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:09:19 2022] DELETE /compute/v2.1/os-volumes/9bbc21ca-44dc-404e-82e1-941cbd4c334e => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:09:19.353499 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3f417b6c-d2d4-41db-aa72-36ce26ed1c3b tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Calling method '.version_select at 0x7f4468271e50>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:19.381902 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-3f417b6c-d2d4-41db-aa72-36ce26ed1c3b tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] HTTP exception thrown: Volume 15c714ad-e791-4441-9c86-94c4db486859 could not be found. Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3f417b6c-d2d4-41db-aa72-36ce26ed1c3b tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Request method failure captured: Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/15c714ad-e791-4441-9c86-94c4db486859 HTTP/1.1 Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi596Oe0AMY_36g14Tb_0ldUz5BaWgQTrcurdT-zjioHvmZySKPnM78igxYeTRhcroQKBH1X6clJ4RLF7oCXCrURiSLBqRERbCpF_I2IR-O_rnXcaLXBu17kPfGtYtMoJde-6c4Pq6nSoYt0v3lPdTFlYNlENzcQPo2SrHuVMiHWcG7c4 Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:09:19.387312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_26287d69715e40d5a8c666a976c2ac3e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/26287d69715e40d5a8c666a976c2ac3e"}]}] Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 26287d69715e40d5a8c666a976c2ac3e Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-187284388 Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: bce1abf62a5a4dfeaf704e18823c56dd Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-187284388-project Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Volume 15c714ad-e791-4441-9c86-94c4db486859 could not be found. Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '15c714ad-e791-4441-9c86-94c4db486859'} Aug 01 14:09:19.388734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15c714ad-e791-4441-9c86-94c4db486859 could not be found. (HTTP 404) (Request-ID: req-d843483d-c316-41a9-a50d-d4ef4008fc2d) Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:09:19.390525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15c714ad-e791-4441-9c86-94c4db486859 could not be found. Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:09:19.391471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15c714ad-e791-4441-9c86-94c4db486859 could not be found. Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15c714ad-e791-4441-9c86-94c4db486859 could not be found. Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3f417b6c-d2d4-41db-aa72-36ce26ed1c3b tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] Returning 404 to user: Volume 15c714ad-e791-4441-9c86-94c4db486859 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3f417b6c-d2d4-41db-aa72-36ce26ed1c3b tempest-VolumesNegativeTest-187284388 tempest-VolumesNegativeTest-187284388-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/15c714ad-e791-4441-9c86-94c4db486859" status: 404 len: 109 microversion: 2.1 time: 0.041276 Aug 01 14:09:19.392562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 40/78] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:09:19 2022] GET /compute/v2.1/os-volumes/15c714ad-e791-4441-9c86-94c4db486859 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:09:19.423610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:19.424957 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:19.432302 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.432772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.433667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.434260 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.497917 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:19.506575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:19.508461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:19.510316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-48a4a1b1-7fea-49c7-ad9c-16c1c7796bfd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1340 microversion: 2.20 time: 0.091211 Aug 01 14:09:19.511046 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 39/79] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:19 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:19.858138 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-af89be59-89b4-4631-928e-1fa8e8596e32 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:19.858760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-af89be59-89b4-4631-928e-1fa8e8596e32 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:19.865650 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af89be59-89b4-4631-928e-1fa8e8596e32 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.866104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af89be59-89b4-4631-928e-1fa8e8596e32 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.867164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af89be59-89b4-4631-928e-1fa8e8596e32 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.867809 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af89be59-89b4-4631-928e-1fa8e8596e32 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.953777 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-836d6bbc-49db-4c8e-a37c-c28cbf1bd6b0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:19.954765 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-836d6bbc-49db-4c8e-a37c-c28cbf1bd6b0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:19.964667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-836d6bbc-49db-4c8e-a37c-c28cbf1bd6b0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.965464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-836d6bbc-49db-4c8e-a37c-c28cbf1bd6b0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:19.966585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-836d6bbc-49db-4c8e-a37c-c28cbf1bd6b0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:19.967266 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-836d6bbc-49db-4c8e-a37c-c28cbf1bd6b0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:20.113139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-af89be59-89b4-4631-928e-1fa8e8596e32 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:20.122243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-af89be59-89b4-4631-928e-1fa8e8596e32 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.268143 Aug 01 14:09:20.122826 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 41/80] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:19 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:20.141257 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ea07a5f6-6ab6-4a16-822f-1096d02bbc3d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:20.144894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ea07a5f6-6ab6-4a16-822f-1096d02bbc3d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:20.154103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea07a5f6-6ab6-4a16-822f-1096d02bbc3d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:20.154646 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea07a5f6-6ab6-4a16-822f-1096d02bbc3d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:20.155437 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea07a5f6-6ab6-4a16-822f-1096d02bbc3d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:20.155880 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea07a5f6-6ab6-4a16-822f-1096d02bbc3d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:20.171133 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-836d6bbc-49db-4c8e-a37c-c28cbf1bd6b0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:20.183739 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-836d6bbc-49db-4c8e-a37c-c28cbf1bd6b0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.233703 Aug 01 14:09:20.192515 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 40/81] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:19 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:20.237561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ea07a5f6-6ab6-4a16-822f-1096d02bbc3d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:20.247983 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ea07a5f6-6ab6-4a16-822f-1096d02bbc3d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1298 microversion: 2.1 time: 0.122442 Aug 01 14:09:20.248884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 42/82] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:20 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1298 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:20.541045 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:20.541904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:20.551657 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:20.552239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:20.556713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:20.556713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:20.679370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:20.706861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:20.712711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:20.720119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-95f7d6bc-17bd-4cca-8018-7d06de7bc89a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1340 microversion: 2.20 time: 0.182834 Aug 01 14:09:20.734122 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 41/83] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:20 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1340 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:21.150440 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2361bad-2e84-4b9b-8ba1-ad7f533ec2cb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:21.151653 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2361bad-2e84-4b9b-8ba1-ad7f533ec2cb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:21.161664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2361bad-2e84-4b9b-8ba1-ad7f533ec2cb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.162828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2361bad-2e84-4b9b-8ba1-ad7f533ec2cb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.163965 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2361bad-2e84-4b9b-8ba1-ad7f533ec2cb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.164707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2361bad-2e84-4b9b-8ba1-ad7f533ec2cb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.205846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-13c55e2f-9ddc-40e8-a096-305b5d2d3246 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:21.206742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-13c55e2f-9ddc-40e8-a096-305b5d2d3246 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:21.212220 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=4 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.213173 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=20 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.227146 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-13c55e2f-9ddc-40e8-a096-305b5d2d3246 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.228282 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-13c55e2f-9ddc-40e8-a096-305b5d2d3246 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.238553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-13c55e2f-9ddc-40e8-a096-305b5d2d3246 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.240887 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-13c55e2f-9ddc-40e8-a096-305b5d2d3246 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.502861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-13c55e2f-9ddc-40e8-a096-305b5d2d3246 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:21.509014 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.518667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-13c55e2f-9ddc-40e8-a096-305b5d2d3246 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.316765 Aug 01 14:09:21.519911 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 42/84] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:21 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:21.527426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b2361bad-2e84-4b9b-8ba1-ad7f533ec2cb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:21.535109 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.541929 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d18b4694-b162-475c-a744-4a9f4cd6adee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:21.544472 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2361bad-2e84-4b9b-8ba1-ad7f533ec2cb tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.399627 Aug 01 14:09:21.563538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 43/85] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:21 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:21.563941 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d18b4694-b162-475c-a744-4a9f4cd6adee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:21.574860 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d18b4694-b162-475c-a744-4a9f4cd6adee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.575422 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d18b4694-b162-475c-a744-4a9f4cd6adee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.576305 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d18b4694-b162-475c-a744-4a9f4cd6adee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.583274 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d18b4694-b162-475c-a744-4a9f4cd6adee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.759239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d18b4694-b162-475c-a744-4a9f4cd6adee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:21.765588 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:21.770403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:21.770522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d18b4694-b162-475c-a744-4a9f4cd6adee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1298 microversion: 2.1 time: 0.248197 Aug 01 14:09:21.781917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.783003 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.787436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:21.788159 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:21.794068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 43/86] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:21 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1298 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:22.174611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:22.210203 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:22.213680 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:22.220000 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aa283688-609b-41a7-bea6-14c84e6e5faa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1340 microversion: 2.20 time: 0.457041 Aug 01 14:09:22.237160 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 44/87] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:21 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1340 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:22.547140 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-22ac4dff-177e-4f47-8ff0-69e0c115f1ef tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:22.550380 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-22ac4dff-177e-4f47-8ff0-69e0c115f1ef tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:22.566387 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22ac4dff-177e-4f47-8ff0-69e0c115f1ef tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:22.567313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22ac4dff-177e-4f47-8ff0-69e0c115f1ef tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:22.572784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22ac4dff-177e-4f47-8ff0-69e0c115f1ef tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:22.583293 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e27dbf1b-e27a-4c61-925b-a4575f49f076 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:22.589878 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e27dbf1b-e27a-4c61-925b-a4575f49f076 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:22.595711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22ac4dff-177e-4f47-8ff0-69e0c115f1ef tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:22.612607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=30 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:22.622863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e27dbf1b-e27a-4c61-925b-a4575f49f076 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:22.629040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e27dbf1b-e27a-4c61-925b-a4575f49f076 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:22.637570 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e27dbf1b-e27a-4c61-925b-a4575f49f076 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:22.638947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e27dbf1b-e27a-4c61-925b-a4575f49f076 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:23.092067 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-22ac4dff-177e-4f47-8ff0-69e0c115f1ef tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:23.106928 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-22ac4dff-177e-4f47-8ff0-69e0c115f1ef tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.566843 Aug 01 14:09:23.109222 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 44/88] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:22 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:23.126431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-98b1612f-6ff6-498a-a866-e10ac7366456 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:23.127293 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-98b1612f-6ff6-498a-a866-e10ac7366456 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:23.138051 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-98b1612f-6ff6-498a-a866-e10ac7366456 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:23.138904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-98b1612f-6ff6-498a-a866-e10ac7366456 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:23.139991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-98b1612f-6ff6-498a-a866-e10ac7366456 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:23.140746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-98b1612f-6ff6-498a-a866-e10ac7366456 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:23.322251 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-98b1612f-6ff6-498a-a866-e10ac7366456 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:23.334028 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-98b1612f-6ff6-498a-a866-e10ac7366456 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1298 microversion: 2.1 time: 0.223499 Aug 01 14:09:23.348616 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 45/89] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:23 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1298 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:23.359743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:23.360370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:23.374336 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:23.374815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:23.375684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:23.376145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:23.559441 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:23.569506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:23.571028 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:23.572134 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ce5ffe22-c850-4776-9520-f086adc60275 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1340 microversion: 2.20 time: 0.222484 Aug 01 14:09:23.596566 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 46/90] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:23 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1340 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:24.134589 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e27dbf1b-e27a-4c61-925b-a4575f49f076 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:24.136319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3f2d8dd4-a5b2-46ee-a025-cf74ce0e28cb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:24.137263 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3f2d8dd4-a5b2-46ee-a025-cf74ce0e28cb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:24.141282 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:24.145748 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e27dbf1b-e27a-4c61-925b-a4575f49f076 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 1.568856 Aug 01 14:09:24.148450 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f2d8dd4-a5b2-46ee-a025-cf74ce0e28cb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.149359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f2d8dd4-a5b2-46ee-a025-cf74ce0e28cb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.162079 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 45/91] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:22 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:24.171721 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f2d8dd4-a5b2-46ee-a025-cf74ce0e28cb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.172627 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f2d8dd4-a5b2-46ee-a025-cf74ce0e28cb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.361515 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dc4d9822-48de-4ffa-9067-3ca41a16bd2f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:24.362492 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dc4d9822-48de-4ffa-9067-3ca41a16bd2f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:24.374174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc4d9822-48de-4ffa-9067-3ca41a16bd2f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.375248 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc4d9822-48de-4ffa-9067-3ca41a16bd2f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.376295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc4d9822-48de-4ffa-9067-3ca41a16bd2f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.377528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc4d9822-48de-4ffa-9067-3ca41a16bd2f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.459256 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3f2d8dd4-a5b2-46ee-a025-cf74ce0e28cb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:24.467211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3f2d8dd4-a5b2-46ee-a025-cf74ce0e28cb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.339073 Aug 01 14:09:24.467797 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 47/92] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:24 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:24.683183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dc4d9822-48de-4ffa-9067-3ca41a16bd2f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:24.692972 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-243becf2-0076-49f1-a8de-70928c55c552 req-d4d6dd59-49df-4c24-9a42-23196b4e7f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8fa6e78-136c-4153-a57c-926647075a19", "tag": "f9d5077c-63d1-442e-b8ce-cf6ff90efb92"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:24.694693 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dc4d9822-48de-4ffa-9067-3ca41a16bd2f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.342304 Aug 01 14:09:24.705685 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 46/93] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:24 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:24.715465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:24.716504 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:24.721080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-243becf2-0076-49f1-a8de-70928c55c552 req-d4d6dd59-49df-4c24-9a42-23196b4e7f16 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.721617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-243becf2-0076-49f1-a8de-70928c55c552 req-d4d6dd59-49df-4c24-9a42-23196b4e7f16 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.723837 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.725077 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.726100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.726711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.746598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-243becf2-0076-49f1-a8de-70928c55c552 req-d4d6dd59-49df-4c24-9a42-23196b4e7f16 service nova] Creating event network-changed:f9d5077c-63d1-442e-b8ce-cf6ff90efb92 for instance e8fa6e78-136c-4153-a57c-926647075a19 on hv-cinder-84713 Aug 01 14:09:24.747508 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-243becf2-0076-49f1-a8de-70928c55c552 req-d4d6dd59-49df-4c24-9a42-23196b4e7f16 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117857) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 01 14:09:24.748895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e53a2ec0-8e4f-42c2-bd07-6bd8fc339bba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.749684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e53a2ec0-8e4f-42c2-bd07-6bd8fc339bba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.750925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e53a2ec0-8e4f-42c2-bd07-6bd8fc339bba None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.751741 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e53a2ec0-8e4f-42c2-bd07-6bd8fc339bba None None] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.768431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.compute.rpcapi [None req-e53a2ec0-8e4f-42c2-bd07-6bd8fc339bba None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 01 14:09:24.770117 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e53a2ec0-8e4f-42c2-bd07-6bd8fc339bba None None] Releasing lock "compute-rpcapi-router" {{(pid=117857) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 01 14:09:24.803563 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e53a2ec0-8e4f-42c2-bd07-6bd8fc339bba None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.333817 Aug 01 14:09:24.809184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 48/94] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:24.827453 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-895adedc-a881-40c8-aadf-70f29a40dd9f req-5e384f22-3a9a-4054-8f3d-d9523569081f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8437bc61-6b11-4e15-afb8-f748b55a9e06", "tag": "b980b564-8216-40d9-b117-a88ee864fd73"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:24.837590 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-895adedc-a881-40c8-aadf-70f29a40dd9f req-5e384f22-3a9a-4054-8f3d-d9523569081f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:24.838277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-895adedc-a881-40c8-aadf-70f29a40dd9f req-5e384f22-3a9a-4054-8f3d-d9523569081f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:24.853486 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-895adedc-a881-40c8-aadf-70f29a40dd9f req-5e384f22-3a9a-4054-8f3d-d9523569081f service nova] Creating event network-changed:b980b564-8216-40d9-b117-a88ee864fd73 for instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 on hv-cinder-84713 Aug 01 14:09:24.860133 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-895adedc-a881-40c8-aadf-70f29a40dd9f req-5e384f22-3a9a-4054-8f3d-d9523569081f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036513 Aug 01 14:09:24.861029 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 49/95] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:24.936470 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:24.944431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:24.951799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:24.953883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-98a46bb5-281a-4387-a141-d04f86bf67b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1340 microversion: 2.20 time: 0.246927 Aug 01 14:09:24.957885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 47/96] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:24 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1340 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:25.172326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-cd665412-b2b1-4884-843d-a4dfae27cdbf tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:25.173331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-cd665412-b2b1-4884-843d-a4dfae27cdbf tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:25.182619 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd665412-b2b1-4884-843d-a4dfae27cdbf tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.183401 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd665412-b2b1-4884-843d-a4dfae27cdbf tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:25.184575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd665412-b2b1-4884-843d-a4dfae27cdbf tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.185281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd665412-b2b1-4884-843d-a4dfae27cdbf tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:25.431067 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-cd665412-b2b1-4884-843d-a4dfae27cdbf tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:25.439038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-cd665412-b2b1-4884-843d-a4dfae27cdbf tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.271971 Aug 01 14:09:25.439762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 50/97] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:25 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:25.488357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4b73f1f9-9c27-44a9-93ae-9f3cb763adf3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:25.490435 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4b73f1f9-9c27-44a9-93ae-9f3cb763adf3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:25.498281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b73f1f9-9c27-44a9-93ae-9f3cb763adf3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.499101 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b73f1f9-9c27-44a9-93ae-9f3cb763adf3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:25.500049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b73f1f9-9c27-44a9-93ae-9f3cb763adf3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.500746 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b73f1f9-9c27-44a9-93ae-9f3cb763adf3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:25.684860 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4b73f1f9-9c27-44a9-93ae-9f3cb763adf3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:25.693460 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4b73f1f9-9c27-44a9-93ae-9f3cb763adf3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.208742 Aug 01 14:09:25.694047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 48/98] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:25 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:25.717657 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7bb1a0d5-5ad5-4b2b-861b-fd21517bc89d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:25.719142 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7bb1a0d5-5ad5-4b2b-861b-fd21517bc89d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:25.728420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bb1a0d5-5ad5-4b2b-861b-fd21517bc89d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.729063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bb1a0d5-5ad5-4b2b-861b-fd21517bc89d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:25.729973 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bb1a0d5-5ad5-4b2b-861b-fd21517bc89d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.730467 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bb1a0d5-5ad5-4b2b-861b-fd21517bc89d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:25.887644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7bb1a0d5-5ad5-4b2b-861b-fd21517bc89d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:25.895747 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7bb1a0d5-5ad5-4b2b-861b-fd21517bc89d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.184092 Aug 01 14:09:25.896318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 51/99] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:25 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:25.979396 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:25.980234 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:25.993717 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.994186 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:25.994968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:25.995394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:26.223600 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:26.259168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:26.260856 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:26.262691 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-12488a0b-2beb-49d8-afd9-a089cf2ee6ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.287525 Aug 01 14:09:26.263255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 49/100] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:25 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:26.460146 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-eb855f60-6ebd-4cc1-beb6-e4ed099e1301 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:26.460777 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-eb855f60-6ebd-4cc1-beb6-e4ed099e1301 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:26.467356 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb855f60-6ebd-4cc1-beb6-e4ed099e1301 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:26.468063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb855f60-6ebd-4cc1-beb6-e4ed099e1301 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:26.469164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb855f60-6ebd-4cc1-beb6-e4ed099e1301 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:26.469681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb855f60-6ebd-4cc1-beb6-e4ed099e1301 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:26.616190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-eb855f60-6ebd-4cc1-beb6-e4ed099e1301 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:26.626327 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-eb855f60-6ebd-4cc1-beb6-e4ed099e1301 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.169396 Aug 01 14:09:26.627117 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 52/101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:26 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:26.715946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-058e57f8-44c8-48e7-abc2-94999fa2407f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:26.717333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-058e57f8-44c8-48e7-abc2-94999fa2407f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:26.729611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-058e57f8-44c8-48e7-abc2-94999fa2407f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:26.730180 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-058e57f8-44c8-48e7-abc2-94999fa2407f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:26.731030 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-058e57f8-44c8-48e7-abc2-94999fa2407f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:26.731603 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-058e57f8-44c8-48e7-abc2-94999fa2407f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:26.890696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-058e57f8-44c8-48e7-abc2-94999fa2407f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:26.902543 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-058e57f8-44c8-48e7-abc2-94999fa2407f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.191635 Aug 01 14:09:26.903118 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 50/102] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:26 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:26.919225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bee56f4d-9962-465b-8daf-f541fa440fee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:26.919962 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bee56f4d-9962-465b-8daf-f541fa440fee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:26.926347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bee56f4d-9962-465b-8daf-f541fa440fee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:26.926843 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bee56f4d-9962-465b-8daf-f541fa440fee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:26.927529 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bee56f4d-9962-465b-8daf-f541fa440fee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:26.927960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bee56f4d-9962-465b-8daf-f541fa440fee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:27.105974 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bee56f4d-9962-465b-8daf-f541fa440fee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:27.114096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bee56f4d-9962-465b-8daf-f541fa440fee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.198611 Aug 01 14:09:27.114655 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 53/103] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:26 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:27.286903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:27.287690 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:27.294141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:27.294771 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:27.295783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:27.296551 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:27.454947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:27.464266 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:27.466317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:27.467506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3f7ed272-08ed-4260-aef5-db276fb62f9e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.185975 Aug 01 14:09:27.468131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 51/104] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:27 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:27.647244 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-51ff1e87-0ddd-4426-8a93-c41c7195e9f1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:27.648079 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-51ff1e87-0ddd-4426-8a93-c41c7195e9f1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:27.654227 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51ff1e87-0ddd-4426-8a93-c41c7195e9f1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:27.654805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51ff1e87-0ddd-4426-8a93-c41c7195e9f1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:27.655699 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51ff1e87-0ddd-4426-8a93-c41c7195e9f1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:27.656169 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51ff1e87-0ddd-4426-8a93-c41c7195e9f1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:27.810802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-51ff1e87-0ddd-4426-8a93-c41c7195e9f1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:27.823443 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-51ff1e87-0ddd-4426-8a93-c41c7195e9f1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.179785 Aug 01 14:09:27.836430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 54/105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:27 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:27.931322 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c5466bff-ed73-4395-9e3a-fa25a045ff52 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:27.932543 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c5466bff-ed73-4395-9e3a-fa25a045ff52 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:27.941121 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5466bff-ed73-4395-9e3a-fa25a045ff52 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:27.942181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5466bff-ed73-4395-9e3a-fa25a045ff52 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:27.943127 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5466bff-ed73-4395-9e3a-fa25a045ff52 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:27.943776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5466bff-ed73-4395-9e3a-fa25a045ff52 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:28.031684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=8 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.115782 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c5466bff-ed73-4395-9e3a-fa25a045ff52 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:28.124890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c5466bff-ed73-4395-9e3a-fa25a045ff52 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.202923 Aug 01 14:09:28.125725 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 52/106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:27 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:28.134728 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d8e2c449-a1ce-4cfa-8cc0-33a8a5dd943f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:28.135344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d8e2c449-a1ce-4cfa-8cc0-33a8a5dd943f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:28.157164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d8e2c449-a1ce-4cfa-8cc0-33a8a5dd943f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:28.157626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d8e2c449-a1ce-4cfa-8cc0-33a8a5dd943f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:28.160274 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d8e2c449-a1ce-4cfa-8cc0-33a8a5dd943f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:28.161549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d8e2c449-a1ce-4cfa-8cc0-33a8a5dd943f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:28.403639 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d8e2c449-a1ce-4cfa-8cc0-33a8a5dd943f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:28.414454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d8e2c449-a1ce-4cfa-8cc0-33a8a5dd943f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.283144 Aug 01 14:09:28.428508 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 55/107] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:28 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:28.490788 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:28.491826 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:28.501739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:28.504980 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:28.513568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:28.514065 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:28.706316 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:28.754528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:28.756049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:28.765711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-63fb5bc9-8434-4824-9ccb-22ac25c39992 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.277120 Aug 01 14:09:28.765940 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 53/108] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:28 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:28.845688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-81fee8f1-c77f-49b7-b78a-e6b7150eb51c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:28.846607 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-81fee8f1-c77f-49b7-b78a-e6b7150eb51c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:28.855369 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81fee8f1-c77f-49b7-b78a-e6b7150eb51c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:28.856406 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81fee8f1-c77f-49b7-b78a-e6b7150eb51c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:28.857388 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81fee8f1-c77f-49b7-b78a-e6b7150eb51c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:28.858027 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81fee8f1-c77f-49b7-b78a-e6b7150eb51c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:29.145670 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5f0386d1-24ff-41ca-ae1c-92901eefa8b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:29.146291 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5f0386d1-24ff-41ca-ae1c-92901eefa8b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:29.160833 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f0386d1-24ff-41ca-ae1c-92901eefa8b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:29.161285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f0386d1-24ff-41ca-ae1c-92901eefa8b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:29.162074 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f0386d1-24ff-41ca-ae1c-92901eefa8b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:29.162513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5f0386d1-24ff-41ca-ae1c-92901eefa8b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:29.202790 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-81fee8f1-c77f-49b7-b78a-e6b7150eb51c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:29.210683 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-81fee8f1-c77f-49b7-b78a-e6b7150eb51c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.370239 Aug 01 14:09:29.220083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 56/109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:28 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:29.443691 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-76c1e4a2-25bd-4fd6-a092-ab12b42b1236 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:29.444314 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-76c1e4a2-25bd-4fd6-a092-ab12b42b1236 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:29.461329 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76c1e4a2-25bd-4fd6-a092-ab12b42b1236 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:29.461793 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76c1e4a2-25bd-4fd6-a092-ab12b42b1236 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:29.464135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76c1e4a2-25bd-4fd6-a092-ab12b42b1236 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:29.464613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76c1e4a2-25bd-4fd6-a092-ab12b42b1236 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:30.314558 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5f0386d1-24ff-41ca-ae1c-92901eefa8b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:30.331500 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5f0386d1-24ff-41ca-ae1c-92901eefa8b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 1.189747 Aug 01 14:09:30.333495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 54/110] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:29 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:30.350582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:30.352824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:30.370706 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:30.372387 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:30.373609 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:30.375560 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:30.591037 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-76c1e4a2-25bd-4fd6-a092-ab12b42b1236 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:30.604521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-76c1e4a2-25bd-4fd6-a092-ab12b42b1236 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 1.168555 Aug 01 14:09:30.606689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 57/111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:29 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:30.614649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ac2cfb65-0aea-434f-a571-2d02ebc4cd60 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:30.615487 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ac2cfb65-0aea-434f-a571-2d02ebc4cd60 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:30.635640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ac2cfb65-0aea-434f-a571-2d02ebc4cd60 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:30.653176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ac2cfb65-0aea-434f-a571-2d02ebc4cd60 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:30.657174 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ac2cfb65-0aea-434f-a571-2d02ebc4cd60 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:30.660139 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ac2cfb65-0aea-434f-a571-2d02ebc4cd60 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:31.755784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ac2cfb65-0aea-434f-a571-2d02ebc4cd60 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:31.776381 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ac2cfb65-0aea-434f-a571-2d02ebc4cd60 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 1.166951 Aug 01 14:09:31.792414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 58/112] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:30 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:31.792414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-081a0c93-cbf6-41ab-96ff-5689c32d48be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:31.792414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-081a0c93-cbf6-41ab-96ff-5689c32d48be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:31.799414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:31.801738 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-081a0c93-cbf6-41ab-96ff-5689c32d48be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:31.802245 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-081a0c93-cbf6-41ab-96ff-5689c32d48be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:31.803157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-081a0c93-cbf6-41ab-96ff-5689c32d48be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:31.803761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-081a0c93-cbf6-41ab-96ff-5689c32d48be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:31.816378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:31.821256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:31.826366 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6b278190-4f2f-4431-9437-d5a0a3c22f84 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 1.489143 Aug 01 14:09:31.829410 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 55/113] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:30 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:31.845563 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-74edbe39-7aa5-4934-b05d-a6ec5d729878 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:31.847533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-74edbe39-7aa5-4934-b05d-a6ec5d729878 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:31.859023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74edbe39-7aa5-4934-b05d-a6ec5d729878 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:31.859725 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74edbe39-7aa5-4934-b05d-a6ec5d729878 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:31.861546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74edbe39-7aa5-4934-b05d-a6ec5d729878 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:31.864658 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74edbe39-7aa5-4934-b05d-a6ec5d729878 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.212233 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-74edbe39-7aa5-4934-b05d-a6ec5d729878 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:32.226661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-74edbe39-7aa5-4934-b05d-a6ec5d729878 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.395836 Aug 01 14:09:32.227568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 56/114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:31 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:32.244258 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-a6eb05fa-e2d5-4f7d-b6f9-3ca88ac54157 req-3bfeb40f-23a4-43e1-a3cf-9a869ca135b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fd7ad6-9939-4561-b0fa-f45f8602eccf", "tag": "74f5404a-20d0-4b4a-8fec-5f4dbc58380a"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:32.262093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-a6eb05fa-e2d5-4f7d-b6f9-3ca88ac54157 req-3bfeb40f-23a4-43e1-a3cf-9a869ca135b6 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.262612 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-a6eb05fa-e2d5-4f7d-b6f9-3ca88ac54157 req-3bfeb40f-23a4-43e1-a3cf-9a869ca135b6 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.278929 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-a6eb05fa-e2d5-4f7d-b6f9-3ca88ac54157 req-3bfeb40f-23a4-43e1-a3cf-9a869ca135b6 service nova] Creating event network-changed:74f5404a-20d0-4b4a-8fec-5f4dbc58380a for instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf on hv-cinder-84713 Aug 01 14:09:32.284709 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-a6eb05fa-e2d5-4f7d-b6f9-3ca88ac54157 req-3bfeb40f-23a4-43e1-a3cf-9a869ca135b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055794 Aug 01 14:09:32.285451 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 57/115] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:32.301392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-2f01b62b-c95b-4c07-a550-edee892fcab9 req-dac7bf44-2bfe-4d47-aad0-a33742b9645b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cc4e77-f019-4285-ac19-c01b7c96a515", "tag": "07e3e2e9-2e5a-45dc-8c38-d0fda52efe94"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:32.309502 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-081a0c93-cbf6-41ab-96ff-5689c32d48be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:32.321013 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-081a0c93-cbf6-41ab-96ff-5689c32d48be tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.540401 Aug 01 14:09:32.328217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-2f01b62b-c95b-4c07-a550-edee892fcab9 req-dac7bf44-2bfe-4d47-aad0-a33742b9645b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.328698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-2f01b62b-c95b-4c07-a550-edee892fcab9 req-dac7bf44-2bfe-4d47-aad0-a33742b9645b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.336725 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 59/116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:31 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:32.345018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-2f01b62b-c95b-4c07-a550-edee892fcab9 req-dac7bf44-2bfe-4d47-aad0-a33742b9645b service nova] Creating event network-changed:07e3e2e9-2e5a-45dc-8c38-d0fda52efe94 for instance 78cc4e77-f019-4285-ac19-c01b7c96a515 on hv-cinder-84713 Aug 01 14:09:32.350042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-2f01b62b-c95b-4c07-a550-edee892fcab9 req-dac7bf44-2bfe-4d47-aad0-a33742b9645b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053076 Aug 01 14:09:32.351307 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 58/117] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:32.799115 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6d12b660-343a-4cd2-be12-babcb0cc5b6c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:32.799798 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6d12b660-343a-4cd2-be12-babcb0cc5b6c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:32.809436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6d12b660-343a-4cd2-be12-babcb0cc5b6c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.809926 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6d12b660-343a-4cd2-be12-babcb0cc5b6c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.810736 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6d12b660-343a-4cd2-be12-babcb0cc5b6c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.811185 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6d12b660-343a-4cd2-be12-babcb0cc5b6c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.833869 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:32.858632 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:32.860524 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:32.869475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.871178 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.872227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:32.873424 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:32.967837 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6d12b660-343a-4cd2-be12-babcb0cc5b6c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:32.977060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6d12b660-343a-4cd2-be12-babcb0cc5b6c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.181732 Aug 01 14:09:32.978496 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 60/118] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:32 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:33.029189 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:33.038785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:33.041024 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:33.042495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-20bd17ae-b1ee-4e1a-bc2e-3130fd082ece tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.190082 Aug 01 14:09:33.043573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 59/119] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:32 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:33.247532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-eba28be4-032a-4ce4-8969-f61946876f95 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:33.248105 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-eba28be4-032a-4ce4-8969-f61946876f95 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:33.254212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eba28be4-032a-4ce4-8969-f61946876f95 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:33.254810 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eba28be4-032a-4ce4-8969-f61946876f95 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:33.255582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eba28be4-032a-4ce4-8969-f61946876f95 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:33.256238 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eba28be4-032a-4ce4-8969-f61946876f95 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:33.341763 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d3234709-81cf-4be3-9873-5d0726bdd7af tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:33.342390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d3234709-81cf-4be3-9873-5d0726bdd7af tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:33.354671 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3234709-81cf-4be3-9873-5d0726bdd7af tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:33.355354 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3234709-81cf-4be3-9873-5d0726bdd7af tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:33.356328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3234709-81cf-4be3-9873-5d0726bdd7af tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:33.357119 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d3234709-81cf-4be3-9873-5d0726bdd7af tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:33.410901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-eba28be4-032a-4ce4-8969-f61946876f95 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:33.449950 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-eba28be4-032a-4ce4-8969-f61946876f95 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.201073 Aug 01 14:09:33.453355 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 61/120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:33 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:33.520232 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d3234709-81cf-4be3-9873-5d0726bdd7af tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:33.529075 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d3234709-81cf-4be3-9873-5d0726bdd7af tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.191205 Aug 01 14:09:33.529651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 60/121] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:33 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:34.000081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-da0484b0-d4ea-4b84-a640-51873095adbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:34.002145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-da0484b0-d4ea-4b84-a640-51873095adbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:34.024013 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-da0484b0-d4ea-4b84-a640-51873095adbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.026274 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-da0484b0-d4ea-4b84-a640-51873095adbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.031145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-da0484b0-d4ea-4b84-a640-51873095adbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.033535 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-da0484b0-d4ea-4b84-a640-51873095adbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.066834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:34.067542 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:34.083190 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.083650 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.089170 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.089621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.327359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-da0484b0-d4ea-4b84-a640-51873095adbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:34.349537 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-da0484b0-d4ea-4b84-a640-51873095adbd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.354228 Aug 01 14:09:34.369792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:34.373915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.375582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 62/122] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:33 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:34.381538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:34.384128 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:34.385750 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b4215bae-6705-4242-a71d-bf9617d33c2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.323334 Aug 01 14:09:34.387210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 61/123] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:34 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:34.474988 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b5989e10-9295-4e00-bcbd-b436a5ce9943 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:34.475936 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b5989e10-9295-4e00-bcbd-b436a5ce9943 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:34.493185 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5989e10-9295-4e00-bcbd-b436a5ce9943 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.494190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5989e10-9295-4e00-bcbd-b436a5ce9943 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.495032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5989e10-9295-4e00-bcbd-b436a5ce9943 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.495478 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5989e10-9295-4e00-bcbd-b436a5ce9943 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.551555 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e77db448-3950-45b8-b341-a20dd9901480 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:34.552788 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e77db448-3950-45b8-b341-a20dd9901480 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:34.568587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e77db448-3950-45b8-b341-a20dd9901480 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.569043 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e77db448-3950-45b8-b341-a20dd9901480 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.582497 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e77db448-3950-45b8-b341-a20dd9901480 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:34.582497 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e77db448-3950-45b8-b341-a20dd9901480 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:34.713279 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b5989e10-9295-4e00-bcbd-b436a5ce9943 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:34.724263 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b5989e10-9295-4e00-bcbd-b436a5ce9943 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.253017 Aug 01 14:09:34.727327 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 63/124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:34 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:34.791829 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e77db448-3950-45b8-b341-a20dd9901480 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:34.800846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e77db448-3950-45b8-b341-a20dd9901480 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.254264 Aug 01 14:09:34.801664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 62/125] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:34 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:35.372765 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dd7a86d1-fb67-46e7-bf21-89f4d655e3d1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:35.373306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dd7a86d1-fb67-46e7-bf21-89f4d655e3d1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:35.375117 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:35.380471 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dd7a86d1-fb67-46e7-bf21-89f4d655e3d1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.381017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dd7a86d1-fb67-46e7-bf21-89f4d655e3d1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.381808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dd7a86d1-fb67-46e7-bf21-89f4d655e3d1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.382258 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dd7a86d1-fb67-46e7-bf21-89f4d655e3d1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.421633 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:35.422451 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:35.428612 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.429163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.430532 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.431040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.521009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dd7a86d1-fb67-46e7-bf21-89f4d655e3d1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:35.528945 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dd7a86d1-fb67-46e7-bf21-89f4d655e3d1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.160303 Aug 01 14:09:35.529517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 64/126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:35 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:35.571761 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:35.579658 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:35.581227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:35.582324 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-64c428dc-778f-4075-96a1-6c91208e93eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.164630 Aug 01 14:09:35.582892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 63/127] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:35 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:35.748161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8df4034e-ac6d-44c9-b4f2-0c21c2fe93fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:35.748795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8df4034e-ac6d-44c9-b4f2-0c21c2fe93fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:35.755320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8df4034e-ac6d-44c9-b4f2-0c21c2fe93fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.755772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8df4034e-ac6d-44c9-b4f2-0c21c2fe93fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.756545 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8df4034e-ac6d-44c9-b4f2-0c21c2fe93fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.756981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8df4034e-ac6d-44c9-b4f2-0c21c2fe93fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.822185 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4016eafa-8165-4169-9b6d-16c2e766c70f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:35.822792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4016eafa-8165-4169-9b6d-16c2e766c70f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:35.828806 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4016eafa-8165-4169-9b6d-16c2e766c70f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.829252 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4016eafa-8165-4169-9b6d-16c2e766c70f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.830017 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4016eafa-8165-4169-9b6d-16c2e766c70f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:35.830478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4016eafa-8165-4169-9b6d-16c2e766c70f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:35.891409 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8df4034e-ac6d-44c9-b4f2-0c21c2fe93fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:35.898918 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8df4034e-ac6d-44c9-b4f2-0c21c2fe93fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.154787 Aug 01 14:09:35.899505 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 65/128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:35 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:35.965395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4016eafa-8165-4169-9b6d-16c2e766c70f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:35.973084 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4016eafa-8165-4169-9b6d-16c2e766c70f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.155312 Aug 01 14:09:35.973638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 64/129] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:35 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:36.549910 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1e608aa9-e7cc-47b0-93d0-ca92dda082f9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:36.550517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1e608aa9-e7cc-47b0-93d0-ca92dda082f9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:36.557194 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1e608aa9-e7cc-47b0-93d0-ca92dda082f9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.557636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1e608aa9-e7cc-47b0-93d0-ca92dda082f9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:36.558384 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1e608aa9-e7cc-47b0-93d0-ca92dda082f9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.558814 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1e608aa9-e7cc-47b0-93d0-ca92dda082f9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:36.606656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:36.607405 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:36.613455 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.613976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:36.614744 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.615179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:36.701227 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1e608aa9-e7cc-47b0-93d0-ca92dda082f9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:36.709705 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1e608aa9-e7cc-47b0-93d0-ca92dda082f9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.163493 Aug 01 14:09:36.715741 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 66/130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:36 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:36.750016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:36.758135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:36.759542 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:36.760675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-283bce5d-8ffc-4f5f-8259-ce598b1d5e3a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.157842 Aug 01 14:09:36.761233 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 65/131] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:36 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:36.921085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-00c56cac-4adb-4ea6-94b4-0bd8f41c1c6b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:36.921827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-00c56cac-4adb-4ea6-94b4-0bd8f41c1c6b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:36.928652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-00c56cac-4adb-4ea6-94b4-0bd8f41c1c6b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.929240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-00c56cac-4adb-4ea6-94b4-0bd8f41c1c6b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:36.930131 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-00c56cac-4adb-4ea6-94b4-0bd8f41c1c6b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:36.930684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-00c56cac-4adb-4ea6-94b4-0bd8f41c1c6b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:36.994558 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e7db095c-e42e-4b05-83ed-4356b9d487c5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:36.995223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e7db095c-e42e-4b05-83ed-4356b9d487c5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:37.002757 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e7db095c-e42e-4b05-83ed-4356b9d487c5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:37.003278 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e7db095c-e42e-4b05-83ed-4356b9d487c5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.004178 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e7db095c-e42e-4b05-83ed-4356b9d487c5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:37.004649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e7db095c-e42e-4b05-83ed-4356b9d487c5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.067143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-00c56cac-4adb-4ea6-94b4-0bd8f41c1c6b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:37.075299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-00c56cac-4adb-4ea6-94b4-0bd8f41c1c6b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.158691 Aug 01 14:09:37.075861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 67/132] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:36 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:37.143708 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e7db095c-e42e-4b05-83ed-4356b9d487c5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:37.152568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e7db095c-e42e-4b05-83ed-4356b9d487c5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.162280 Aug 01 14:09:37.153419 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 66/133] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:36 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:37.732975 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c01ecce9-7eb0-412f-9ca6-1c9630104eb1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:37.733613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c01ecce9-7eb0-412f-9ca6-1c9630104eb1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:37.739813 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c01ecce9-7eb0-412f-9ca6-1c9630104eb1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:37.740260 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c01ecce9-7eb0-412f-9ca6-1c9630104eb1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.741057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c01ecce9-7eb0-412f-9ca6-1c9630104eb1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:37.741516 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c01ecce9-7eb0-412f-9ca6-1c9630104eb1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.784174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:37.785404 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:37.792789 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:37.793245 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.794019 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:37.794452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:37.970710 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c01ecce9-7eb0-412f-9ca6-1c9630104eb1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:37.978452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c01ecce9-7eb0-412f-9ca6-1c9630104eb1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.249256 Aug 01 14:09:37.989591 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 68/134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:37 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:38.097506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c50ff8a2-7c63-4f7d-83f3-3d39ee52d04a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:38.098353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c50ff8a2-7c63-4f7d-83f3-3d39ee52d04a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:38.105556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c50ff8a2-7c63-4f7d-83f3-3d39ee52d04a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.106277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c50ff8a2-7c63-4f7d-83f3-3d39ee52d04a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.107532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c50ff8a2-7c63-4f7d-83f3-3d39ee52d04a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.108312 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c50ff8a2-7c63-4f7d-83f3-3d39ee52d04a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.175415 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:38.186237 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:38.187879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:38.189276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2b1246c0-ea33-4a89-bb8b-929aa72ff3c9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.409757 Aug 01 14:09:38.190532 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 67/135] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:37 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:38.195907 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-710c15cc-f65a-4b61-be03-9ac8692f27a0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:38.196959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-710c15cc-f65a-4b61-be03-9ac8692f27a0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:38.203100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-710c15cc-f65a-4b61-be03-9ac8692f27a0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.203622 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-710c15cc-f65a-4b61-be03-9ac8692f27a0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.204500 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-710c15cc-f65a-4b61-be03-9ac8692f27a0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:38.205032 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-710c15cc-f65a-4b61-be03-9ac8692f27a0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:38.273788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c50ff8a2-7c63-4f7d-83f3-3d39ee52d04a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:38.281577 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c50ff8a2-7c63-4f7d-83f3-3d39ee52d04a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.188495 Aug 01 14:09:38.282664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 69/136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:38 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:38.531546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-710c15cc-f65a-4b61-be03-9ac8692f27a0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:38.540322 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-710c15cc-f65a-4b61-be03-9ac8692f27a0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.348682 Aug 01 14:09:38.541463 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 68/137] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:38 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:39.000426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d853f6aa-a616-45d8-bb92-abb348d02009 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:39.000426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d853f6aa-a616-45d8-bb92-abb348d02009 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:39.005322 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d853f6aa-a616-45d8-bb92-abb348d02009 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.005791 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d853f6aa-a616-45d8-bb92-abb348d02009 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.006646 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d853f6aa-a616-45d8-bb92-abb348d02009 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.007002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d853f6aa-a616-45d8-bb92-abb348d02009 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.172693 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d853f6aa-a616-45d8-bb92-abb348d02009 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:39.180922 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d853f6aa-a616-45d8-bb92-abb348d02009 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.186112 Aug 01 14:09:39.181832 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 70/138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:38 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:39.213508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:39.214801 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:39.221564 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.222074 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.222953 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.223395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.302444 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-92886b8f-6454-4bea-bf36-b9cea11d66a8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:39.303128 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-92886b8f-6454-4bea-bf36-b9cea11d66a8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:39.309622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92886b8f-6454-4bea-bf36-b9cea11d66a8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.310267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92886b8f-6454-4bea-bf36-b9cea11d66a8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.311083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92886b8f-6454-4bea-bf36-b9cea11d66a8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.311667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92886b8f-6454-4bea-bf36-b9cea11d66a8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.395037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:39.407906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:39.409686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:39.411181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a29b504c-af93-42cb-ba3f-0dbcf0beecc6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.202644 Aug 01 14:09:39.411929 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 69/139] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:39 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:39.461417 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-92886b8f-6454-4bea-bf36-b9cea11d66a8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:39.470891 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-92886b8f-6454-4bea-bf36-b9cea11d66a8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.172017 Aug 01 14:09:39.472111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 71/140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:39 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:39.561502 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-03c92178-a7be-410e-97ba-aa821f7fa5ec tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:39.562187 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-03c92178-a7be-410e-97ba-aa821f7fa5ec tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:39.568107 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03c92178-a7be-410e-97ba-aa821f7fa5ec tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.568587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03c92178-a7be-410e-97ba-aa821f7fa5ec tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.569348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03c92178-a7be-410e-97ba-aa821f7fa5ec tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:39.570293 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03c92178-a7be-410e-97ba-aa821f7fa5ec tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:39.697603 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-03c92178-a7be-410e-97ba-aa821f7fa5ec tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:39.704945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-03c92178-a7be-410e-97ba-aa821f7fa5ec tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.147435 Aug 01 14:09:39.705507 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 70/141] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:39 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:40.201360 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dc202745-7b53-41e8-b386-eeeb8366a9fe tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:40.201976 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dc202745-7b53-41e8-b386-eeeb8366a9fe tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:40.207893 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc202745-7b53-41e8-b386-eeeb8366a9fe tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.208342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc202745-7b53-41e8-b386-eeeb8366a9fe tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.209138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc202745-7b53-41e8-b386-eeeb8366a9fe tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.209571 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc202745-7b53-41e8-b386-eeeb8366a9fe tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.343758 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dc202745-7b53-41e8-b386-eeeb8366a9fe tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:40.352231 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dc202745-7b53-41e8-b386-eeeb8366a9fe tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.154706 Aug 01 14:09:40.353013 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 72/142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:40 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:40.435440 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:40.437382 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:40.444411 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.445001 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.445782 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.446248 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.493761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7bafd3e6-0784-4017-81ac-191130bd6c89 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:40.494378 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7bafd3e6-0784-4017-81ac-191130bd6c89 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:40.501509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bafd3e6-0784-4017-81ac-191130bd6c89 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.502321 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bafd3e6-0784-4017-81ac-191130bd6c89 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.503674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bafd3e6-0784-4017-81ac-191130bd6c89 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.504417 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bafd3e6-0784-4017-81ac-191130bd6c89 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.673109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7bafd3e6-0784-4017-81ac-191130bd6c89 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:40.682339 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7bafd3e6-0784-4017-81ac-191130bd6c89 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.193906 Aug 01 14:09:40.696610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 73/143] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:40 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:40.698036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:40.706851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:40.708379 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:40.709596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-45b5eddb-1bd7-45f6-bc11-c546c8b8785d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.278529 Aug 01 14:09:40.710774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 71/144] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:40 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:40.731930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e487389f-e095-4552-9537-44d5150fa9b2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:40.732591 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e487389f-e095-4552-9537-44d5150fa9b2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:40.740162 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e487389f-e095-4552-9537-44d5150fa9b2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.740650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e487389f-e095-4552-9537-44d5150fa9b2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.741463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e487389f-e095-4552-9537-44d5150fa9b2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:40.742189 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e487389f-e095-4552-9537-44d5150fa9b2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:40.926344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e487389f-e095-4552-9537-44d5150fa9b2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:40.964613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e487389f-e095-4552-9537-44d5150fa9b2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.238363 Aug 01 14:09:40.973294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 74/145] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:40 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:41.374413 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-787fdc28-2568-4a00-8a07-b3bf13007110 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:41.375118 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-787fdc28-2568-4a00-8a07-b3bf13007110 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:41.385922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-787fdc28-2568-4a00-8a07-b3bf13007110 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:41.386897 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-787fdc28-2568-4a00-8a07-b3bf13007110 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:41.388883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-787fdc28-2568-4a00-8a07-b3bf13007110 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:41.389873 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-787fdc28-2568-4a00-8a07-b3bf13007110 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:41.572250 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-787fdc28-2568-4a00-8a07-b3bf13007110 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:41.581219 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-787fdc28-2568-4a00-8a07-b3bf13007110 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.211217 Aug 01 14:09:41.581854 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 72/146] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:41 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:41.713882 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-364b4ad1-1e8f-45f6-8322-5844ba69d241 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:41.715383 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-364b4ad1-1e8f-45f6-8322-5844ba69d241 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:41.725383 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-364b4ad1-1e8f-45f6-8322-5844ba69d241 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:41.726323 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-364b4ad1-1e8f-45f6-8322-5844ba69d241 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:41.727291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-364b4ad1-1e8f-45f6-8322-5844ba69d241 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:41.727727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-364b4ad1-1e8f-45f6-8322-5844ba69d241 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:41.736036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:41.737348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:41.746457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:41.747342 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:41.748331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:41.749084 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:41.935322 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-364b4ad1-1e8f-45f6-8322-5844ba69d241 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:41.943452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-364b4ad1-1e8f-45f6-8322-5844ba69d241 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.242975 Aug 01 14:09:41.944029 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 75/147] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:41 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:41.953892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:41.962455 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:41.963832 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:41.964954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4fb87156-1e2a-4780-bd44-1241d9c4b2fa tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.233581 Aug 01 14:09:41.965508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 73/148] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:41 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:41.988923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e9898a95-7f7d-4f51-bcc9-95e8220be796 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:41.989749 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e9898a95-7f7d-4f51-bcc9-95e8220be796 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:41.996364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e9898a95-7f7d-4f51-bcc9-95e8220be796 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:41.996852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e9898a95-7f7d-4f51-bcc9-95e8220be796 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:41.997622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e9898a95-7f7d-4f51-bcc9-95e8220be796 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:41.998075 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e9898a95-7f7d-4f51-bcc9-95e8220be796 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:42.381167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e9898a95-7f7d-4f51-bcc9-95e8220be796 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:42.391223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e9898a95-7f7d-4f51-bcc9-95e8220be796 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.406140 Aug 01 14:09:42.392130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 76/149] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:41 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:42.613274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ad724514-bbf2-4d7a-8cac-12c4d81b59e0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:42.615245 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ad724514-bbf2-4d7a-8cac-12c4d81b59e0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:42.641917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ad724514-bbf2-4d7a-8cac-12c4d81b59e0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:42.642576 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ad724514-bbf2-4d7a-8cac-12c4d81b59e0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:42.643806 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ad724514-bbf2-4d7a-8cac-12c4d81b59e0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:42.644895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ad724514-bbf2-4d7a-8cac-12c4d81b59e0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:42.867527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ad724514-bbf2-4d7a-8cac-12c4d81b59e0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:42.880202 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ad724514-bbf2-4d7a-8cac-12c4d81b59e0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.278296 Aug 01 14:09:42.882748 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 74/150] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:42 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:42.971098 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1abf09cb-69d1-4be5-9c67-db6e48693a79 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:42.973744 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1abf09cb-69d1-4be5-9c67-db6e48693a79 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:42.990646 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:42.992692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:42.999437 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1abf09cb-69d1-4be5-9c67-db6e48693a79 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:43.001591 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1abf09cb-69d1-4be5-9c67-db6e48693a79 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:43.002626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1abf09cb-69d1-4be5-9c67-db6e48693a79 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:43.006200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:43.007037 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1abf09cb-69d1-4be5-9c67-db6e48693a79 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:43.013564 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:43.013779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:43.016345 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:43.017402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:43.183004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1abf09cb-69d1-4be5-9c67-db6e48693a79 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:43.193066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1abf09cb-69d1-4be5-9c67-db6e48693a79 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.228522 Aug 01 14:09:43.193652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 77/151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:42 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:43.252924 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:43.262744 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:43.264804 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:43.266486 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-809b20ee-d25d-4234-b84b-01a3e0ef85b3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.282408 Aug 01 14:09:43.267131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 75/152] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:42 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:43.413752 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8b5c3e3d-c6da-4ae9-b8c8-bbb57eae074f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:43.414560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8b5c3e3d-c6da-4ae9-b8c8-bbb57eae074f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:43.421966 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8b5c3e3d-c6da-4ae9-b8c8-bbb57eae074f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:43.422710 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8b5c3e3d-c6da-4ae9-b8c8-bbb57eae074f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:43.423665 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8b5c3e3d-c6da-4ae9-b8c8-bbb57eae074f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:43.424266 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8b5c3e3d-c6da-4ae9-b8c8-bbb57eae074f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:43.608239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8b5c3e3d-c6da-4ae9-b8c8-bbb57eae074f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:43.619345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8b5c3e3d-c6da-4ae9-b8c8-bbb57eae074f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.209947 Aug 01 14:09:43.620244 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 78/153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:43 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:43.906109 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1a34ae8e-abab-4985-86f9-9025fe54d2fd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:43.908947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1a34ae8e-abab-4985-86f9-9025fe54d2fd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:43.919260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8e-abab-4985-86f9-9025fe54d2fd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:43.919924 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8e-abab-4985-86f9-9025fe54d2fd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:43.921282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8e-abab-4985-86f9-9025fe54d2fd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:43.921894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8e-abab-4985-86f9-9025fe54d2fd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:44.098921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1a34ae8e-abab-4985-86f9-9025fe54d2fd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:44.114448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1a34ae8e-abab-4985-86f9-9025fe54d2fd tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.215860 Aug 01 14:09:44.115152 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 76/154] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:43 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:44.217163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-19ce67b9-49a1-4b88-bae5-701328bff9b7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:44.218157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-19ce67b9-49a1-4b88-bae5-701328bff9b7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:44.227236 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-19ce67b9-49a1-4b88-bae5-701328bff9b7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:44.228020 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-19ce67b9-49a1-4b88-bae5-701328bff9b7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:44.229124 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-19ce67b9-49a1-4b88-bae5-701328bff9b7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:44.229831 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-19ce67b9-49a1-4b88-bae5-701328bff9b7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:44.291195 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:44.291810 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:44.308202 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:44.308697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:44.309490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:44.309931 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:44.446902 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-19ce67b9-49a1-4b88-bae5-701328bff9b7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:44.461568 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-19ce67b9-49a1-4b88-bae5-701328bff9b7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.249855 Aug 01 14:09:44.462406 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 79/155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:44 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:44.640450 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ce2ab513-2ef0-4296-930d-758336d7e485 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:44.641333 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ce2ab513-2ef0-4296-930d-758336d7e485 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:44.647522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce2ab513-2ef0-4296-930d-758336d7e485 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:44.648253 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce2ab513-2ef0-4296-930d-758336d7e485 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:44.649280 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce2ab513-2ef0-4296-930d-758336d7e485 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:44.649923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce2ab513-2ef0-4296-930d-758336d7e485 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:44.930804 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:44.939596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:44.941717 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:44.943033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a53300e-9629-41e5-b507-f742fc5bbd2a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.656612 Aug 01 14:09:44.961282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 77/156] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:44 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:44.989686 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce2ab513-2ef0-4296-930d-758336d7e485 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:45.004186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ce2ab513-2ef0-4296-930d-758336d7e485 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.367470 Aug 01 14:09:45.005120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 80/157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:44 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:45.145210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fccea420-9c07-4e13-9ef6-40fd877199a3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:45.145210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fccea420-9c07-4e13-9ef6-40fd877199a3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:45.151997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fccea420-9c07-4e13-9ef6-40fd877199a3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:45.152851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fccea420-9c07-4e13-9ef6-40fd877199a3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:45.153507 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fccea420-9c07-4e13-9ef6-40fd877199a3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:45.154010 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fccea420-9c07-4e13-9ef6-40fd877199a3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:45.190993 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:45.482599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-df3bbaf5-3467-4dc0-9328-4eb2709e5ada tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:45.483847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-df3bbaf5-3467-4dc0-9328-4eb2709e5ada tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:45.504730 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-df3bbaf5-3467-4dc0-9328-4eb2709e5ada tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:45.507890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-df3bbaf5-3467-4dc0-9328-4eb2709e5ada tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:45.509005 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-df3bbaf5-3467-4dc0-9328-4eb2709e5ada tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:45.514276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-df3bbaf5-3467-4dc0-9328-4eb2709e5ada tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:45.660292 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fccea420-9c07-4e13-9ef6-40fd877199a3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:45.673058 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fccea420-9c07-4e13-9ef6-40fd877199a3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.540655 Aug 01 14:09:45.678162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 78/158] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:45 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:45.804510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-df3bbaf5-3467-4dc0-9328-4eb2709e5ada tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:45.825722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-df3bbaf5-3467-4dc0-9328-4eb2709e5ada tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.347060 Aug 01 14:09:45.826320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 81/159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:45 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:45.970608 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:45.971167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:45.977776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:45.978444 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:45.979212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:45.979835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.030431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-91af669a-a884-4002-b712-111fe65487d1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:46.031049 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-91af669a-a884-4002-b712-111fe65487d1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:46.060797 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91af669a-a884-4002-b712-111fe65487d1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.061674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91af669a-a884-4002-b712-111fe65487d1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.064608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91af669a-a884-4002-b712-111fe65487d1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.065060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91af669a-a884-4002-b712-111fe65487d1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.134269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:46.142811 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:46.144653 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:46.145763 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f4aae7cf-b0cb-4085-84ae-38b993b62217 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.180186 Aug 01 14:09:46.146314 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 79/160] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:45 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:46.279636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-91af669a-a884-4002-b712-111fe65487d1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:46.299862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-91af669a-a884-4002-b712-111fe65487d1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.274211 Aug 01 14:09:46.300845 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 82/161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:46 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:46.358295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-403fa602-8b36-48e8-bdf0-89d87201da54 req-d27d6e8c-f39e-4cf5-bc37-18de6c6b428d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "553535d2-88d8-4b52-910e-9e103d370fa3", "name": "network-vif-plugged", "status": "completed", "tag": "65e39196-7685-44bb-83da-d3a148812c3f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:46.385641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-403fa602-8b36-48e8-bdf0-89d87201da54 req-d27d6e8c-f39e-4cf5-bc37-18de6c6b428d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.386082 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-403fa602-8b36-48e8-bdf0-89d87201da54 req-d27d6e8c-f39e-4cf5-bc37-18de6c6b428d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.412797 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-403fa602-8b36-48e8-bdf0-89d87201da54 req-d27d6e8c-f39e-4cf5-bc37-18de6c6b428d service nova] Creating event network-vif-plugged:65e39196-7685-44bb-83da-d3a148812c3f for instance 553535d2-88d8-4b52-910e-9e103d370fa3 on hv-cinder-84713 Aug 01 14:09:46.420728 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-403fa602-8b36-48e8-bdf0-89d87201da54 req-d27d6e8c-f39e-4cf5-bc37-18de6c6b428d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261825 Aug 01 14:09:46.422320 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 80/162] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:46.704794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-031c0b42-e0f0-4bca-b08c-d26a2c730732 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:46.706155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-031c0b42-e0f0-4bca-b08c-d26a2c730732 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:46.712989 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-031c0b42-e0f0-4bca-b08c-d26a2c730732 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.713436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-031c0b42-e0f0-4bca-b08c-d26a2c730732 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.714205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-031c0b42-e0f0-4bca-b08c-d26a2c730732 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.714797 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-031c0b42-e0f0-4bca-b08c-d26a2c730732 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.848517 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2977e9a4-c90f-43e8-9eef-be947b242b84 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:46.849622 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2977e9a4-c90f-43e8-9eef-be947b242b84 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:46.857171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2977e9a4-c90f-43e8-9eef-be947b242b84 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.858243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2977e9a4-c90f-43e8-9eef-be947b242b84 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.859181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2977e9a4-c90f-43e8-9eef-be947b242b84 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:46.859757 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2977e9a4-c90f-43e8-9eef-be947b242b84 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:46.874968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-031c0b42-e0f0-4bca-b08c-d26a2c730732 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:46.885308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-031c0b42-e0f0-4bca-b08c-d26a2c730732 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.184436 Aug 01 14:09:46.886465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 83/163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:46 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:47.023135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2977e9a4-c90f-43e8-9eef-be947b242b84 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:47.032449 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2977e9a4-c90f-43e8-9eef-be947b242b84 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.188277 Aug 01 14:09:47.048262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 81/164] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:46 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:47.174514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:47.175512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:47.183664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:47.184115 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:47.185034 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:47.185556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:47.328099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a7124424-3bd5-40ba-aeed-452c84102a94 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:47.328931 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a7124424-3bd5-40ba-aeed-452c84102a94 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:47.337059 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a7124424-3bd5-40ba-aeed-452c84102a94 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:47.337812 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a7124424-3bd5-40ba-aeed-452c84102a94 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:47.339040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a7124424-3bd5-40ba-aeed-452c84102a94 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:47.339673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a7124424-3bd5-40ba-aeed-452c84102a94 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:47.367177 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:47.377445 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:47.379658 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:47.381208 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-110842a9-139c-402b-9abc-4cf2d97732f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.213651 Aug 01 14:09:47.382267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 84/165] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:47 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:47.515327 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a7124424-3bd5-40ba-aeed-452c84102a94 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:47.524179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a7124424-3bd5-40ba-aeed-452c84102a94 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.203247 Aug 01 14:09:47.524785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 82/166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:47 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:47.910061 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7632d6e8-2b92-4558-9e82-a1a0d65b1cb7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:47.911440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7632d6e8-2b92-4558-9e82-a1a0d65b1cb7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:47.921682 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7632d6e8-2b92-4558-9e82-a1a0d65b1cb7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:47.922691 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7632d6e8-2b92-4558-9e82-a1a0d65b1cb7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:47.924072 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7632d6e8-2b92-4558-9e82-a1a0d65b1cb7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:47.925193 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7632d6e8-2b92-4558-9e82-a1a0d65b1cb7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.055834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-23414154-b40e-4433-ac0b-bd2b5c4e73dd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:48.057241 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-23414154-b40e-4433-ac0b-bd2b5c4e73dd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:48.063420 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-23414154-b40e-4433-ac0b-bd2b5c4e73dd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.064087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-23414154-b40e-4433-ac0b-bd2b5c4e73dd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.064898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-23414154-b40e-4433-ac0b-bd2b5c4e73dd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.065328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-23414154-b40e-4433-ac0b-bd2b5c4e73dd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.097709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7632d6e8-2b92-4558-9e82-a1a0d65b1cb7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:48.110961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7632d6e8-2b92-4558-9e82-a1a0d65b1cb7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.206807 Aug 01 14:09:48.123410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 85/167] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:47 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:48.254836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-23414154-b40e-4433-ac0b-bd2b5c4e73dd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:48.264643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-23414154-b40e-4433-ac0b-bd2b5c4e73dd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.213020 Aug 01 14:09:48.265325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 83/168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:48 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:48.410317 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:48.411079 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:48.417527 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.418069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.418842 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.419276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.551687 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c11cc556-c1ec-4bf0-a9bf-2d5a799908b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:48.552951 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c11cc556-c1ec-4bf0-a9bf-2d5a799908b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:48.565405 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c11cc556-c1ec-4bf0-a9bf-2d5a799908b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.566193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c11cc556-c1ec-4bf0-a9bf-2d5a799908b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.567922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c11cc556-c1ec-4bf0-a9bf-2d5a799908b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.570125 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c11cc556-c1ec-4bf0-a9bf-2d5a799908b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.669970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:48.681867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:48.684762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:48.687177 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f37cf156-f59c-47ee-a133-c3ad1ca5d521 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.283628 Aug 01 14:09:48.687742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 86/169] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:48 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:48.707183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-b88ed08b-dd1e-4676-9850-70566cb1f20d req-47e98f9d-f2a9-4057-915e-57a43b4e335a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8437bc61-6b11-4e15-afb8-f748b55a9e06", "name": "network-vif-plugged", "status": "completed", "tag": "b980b564-8216-40d9-b117-a88ee864fd73"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:48.728420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-b88ed08b-dd1e-4676-9850-70566cb1f20d req-47e98f9d-f2a9-4057-915e-57a43b4e335a service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:48.728904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-b88ed08b-dd1e-4676-9850-70566cb1f20d req-47e98f9d-f2a9-4057-915e-57a43b4e335a service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:48.741176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-b88ed08b-dd1e-4676-9850-70566cb1f20d req-47e98f9d-f2a9-4057-915e-57a43b4e335a service nova] Creating event network-vif-plugged:b980b564-8216-40d9-b117-a88ee864fd73 for instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 on hv-cinder-84713 Aug 01 14:09:48.762357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-b88ed08b-dd1e-4676-9850-70566cb1f20d req-47e98f9d-f2a9-4057-915e-57a43b4e335a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072271 Aug 01 14:09:48.763218 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 87/170] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:48.823762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c11cc556-c1ec-4bf0-a9bf-2d5a799908b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:48.838331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c11cc556-c1ec-4bf0-a9bf-2d5a799908b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.293007 Aug 01 14:09:48.839677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 84/171] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:48 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:49.143663 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ede47531-0df7-49e4-99de-a283573066ec tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:49.144357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ede47531-0df7-49e4-99de-a283573066ec tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:49.151255 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ede47531-0df7-49e4-99de-a283573066ec tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:49.151871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ede47531-0df7-49e4-99de-a283573066ec tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.152650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ede47531-0df7-49e4-99de-a283573066ec tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:49.153232 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ede47531-0df7-49e4-99de-a283573066ec tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.293989 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5e3acb3b-8004-43c4-8110-bffb7f06e723 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:49.296502 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5e3acb3b-8004-43c4-8110-bffb7f06e723 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:49.306125 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ede47531-0df7-49e4-99de-a283573066ec tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:49.310663 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=89 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:49.314568 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ede47531-0df7-49e4-99de-a283573066ec tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.174970 Aug 01 14:09:49.328443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e3acb3b-8004-43c4-8110-bffb7f06e723 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:49.328443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e3acb3b-8004-43c4-8110-bffb7f06e723 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.328443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e3acb3b-8004-43c4-8110-bffb7f06e723 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:49.328443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e3acb3b-8004-43c4-8110-bffb7f06e723 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.330096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 88/172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:49 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:49.554644 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5e3acb3b-8004-43c4-8110-bffb7f06e723 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:49.564540 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5e3acb3b-8004-43c4-8110-bffb7f06e723 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.281114 Aug 01 14:09:49.566722 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 85/173] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:49 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:49.712802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:49.713446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:49.723468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:49.724280 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.725859 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:49.726511 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.862824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5e2c502c-9a92-4541-9801-6d18bc72a13f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:49.863537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5e2c502c-9a92-4541-9801-6d18bc72a13f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:49.872551 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e2c502c-9a92-4541-9801-6d18bc72a13f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:49.873394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e2c502c-9a92-4541-9801-6d18bc72a13f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.874505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e2c502c-9a92-4541-9801-6d18bc72a13f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:49.875120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e2c502c-9a92-4541-9801-6d18bc72a13f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:49.978651 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:49.996309 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:49.999157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:50.000649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c52f637a-ac05-4ac6-98e4-58c23038dd26 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.292768 Aug 01 14:09:50.003044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 89/174] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:49 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:50.129689 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5e2c502c-9a92-4541-9801-6d18bc72a13f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:50.144667 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5e2c502c-9a92-4541-9801-6d18bc72a13f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.286130 Aug 01 14:09:50.145539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 86/175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:49 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:50.335467 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4e511c58-58d4-4b2e-982e-3a4366697673 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:50.336053 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4e511c58-58d4-4b2e-982e-3a4366697673 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:50.346101 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4e511c58-58d4-4b2e-982e-3a4366697673 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:50.346432 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4e511c58-58d4-4b2e-982e-3a4366697673 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:50.347209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4e511c58-58d4-4b2e-982e-3a4366697673 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:50.347640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4e511c58-58d4-4b2e-982e-3a4366697673 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:50.548465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4e511c58-58d4-4b2e-982e-3a4366697673 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:50.557165 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4e511c58-58d4-4b2e-982e-3a4366697673 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.225493 Aug 01 14:09:50.557735 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 90/176] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:50 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:50.589336 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0a7f120a-c26d-4b11-a211-32a4fc603103 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:50.590434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0a7f120a-c26d-4b11-a211-32a4fc603103 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:50.599158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a7f120a-c26d-4b11-a211-32a4fc603103 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:50.600297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a7f120a-c26d-4b11-a211-32a4fc603103 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:50.601662 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a7f120a-c26d-4b11-a211-32a4fc603103 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:50.602269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a7f120a-c26d-4b11-a211-32a4fc603103 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:50.765128 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0a7f120a-c26d-4b11-a211-32a4fc603103 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:50.773741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0a7f120a-c26d-4b11-a211-32a4fc603103 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.190400 Aug 01 14:09:50.774525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 87/177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:50 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:51.029463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:51.030060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:51.036014 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.036454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.037324 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.037894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.169788 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4c711aa9-0dec-4d1a-b135-99e18bda6cfc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:51.170772 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4c711aa9-0dec-4d1a-b135-99e18bda6cfc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:51.181019 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c711aa9-0dec-4d1a-b135-99e18bda6cfc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.181971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c711aa9-0dec-4d1a-b135-99e18bda6cfc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.188109 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c711aa9-0dec-4d1a-b135-99e18bda6cfc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.189400 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c711aa9-0dec-4d1a-b135-99e18bda6cfc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.276763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:51.311381 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:51.313899 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:51.315247 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9dff533e-6abe-4f47-9d91-0e382c410dd7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.289528 Aug 01 14:09:51.315928 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 91/178] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:51 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:51.407780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4c711aa9-0dec-4d1a-b135-99e18bda6cfc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:51.422725 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4c711aa9-0dec-4d1a-b135-99e18bda6cfc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.257902 Aug 01 14:09:51.432518 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 88/179] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:51 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:51.585016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a58f732c-a27f-49ff-88b3-529db35202b1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:51.586318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a58f732c-a27f-49ff-88b3-529db35202b1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:51.593898 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a58f732c-a27f-49ff-88b3-529db35202b1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.594345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a58f732c-a27f-49ff-88b3-529db35202b1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.595456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a58f732c-a27f-49ff-88b3-529db35202b1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.595890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a58f732c-a27f-49ff-88b3-529db35202b1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.750069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a58f732c-a27f-49ff-88b3-529db35202b1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:51.759035 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a58f732c-a27f-49ff-88b3-529db35202b1 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.180674 Aug 01 14:09:51.759713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 92/180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:51 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:51.796395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-edce80fe-a2b7-4fae-87f6-59e63834b862 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:51.797997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-edce80fe-a2b7-4fae-87f6-59e63834b862 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:51.809499 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edce80fe-a2b7-4fae-87f6-59e63834b862 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.810307 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edce80fe-a2b7-4fae-87f6-59e63834b862 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.811083 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edce80fe-a2b7-4fae-87f6-59e63834b862 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:51.811515 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edce80fe-a2b7-4fae-87f6-59e63834b862 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:51.985608 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-edce80fe-a2b7-4fae-87f6-59e63834b862 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:51.997615 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-edce80fe-a2b7-4fae-87f6-59e63834b862 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.206110 Aug 01 14:09:51.998573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 89/181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:51 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:52.234948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-1bf4b2b1-3cde-4585-a620-54c87472bb4b req-5942e30d-e0c0-4872-9017-e539afd1fae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fa6e78-136c-4153-a57c-926647075a19", "name": "network-vif-plugged", "status": "completed", "tag": "f9d5077c-63d1-442e-b8ce-cf6ff90efb92"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:52.260358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-1bf4b2b1-3cde-4585-a620-54c87472bb4b req-5942e30d-e0c0-4872-9017-e539afd1fae2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:52.261514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-1bf4b2b1-3cde-4585-a620-54c87472bb4b req-5942e30d-e0c0-4872-9017-e539afd1fae2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:52.284229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-1bf4b2b1-3cde-4585-a620-54c87472bb4b req-5942e30d-e0c0-4872-9017-e539afd1fae2 service nova] Creating event network-vif-plugged:f9d5077c-63d1-442e-b8ce-cf6ff90efb92 for instance e8fa6e78-136c-4153-a57c-926647075a19 on hv-cinder-84713 Aug 01 14:09:52.292346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-1bf4b2b1-3cde-4585-a620-54c87472bb4b req-5942e30d-e0c0-4872-9017-e539afd1fae2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060179 Aug 01 14:09:52.293343 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 93/182] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:09:52.342290 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:52.343385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:52.371731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:52.372267 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:52.374315 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:52.375204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:52.450380 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-519279ae-80b9-41f6-9f51-9c4adc807c7a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:52.451504 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-519279ae-80b9-41f6-9f51-9c4adc807c7a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:52.458508 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-519279ae-80b9-41f6-9f51-9c4adc807c7a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:52.458986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-519279ae-80b9-41f6-9f51-9c4adc807c7a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:52.459786 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-519279ae-80b9-41f6-9f51-9c4adc807c7a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:52.460176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-519279ae-80b9-41f6-9f51-9c4adc807c7a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:52.656593 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-519279ae-80b9-41f6-9f51-9c4adc807c7a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:52.657402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:52.674457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:52.675386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-519279ae-80b9-41f6-9f51-9c4adc807c7a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.229285 Aug 01 14:09:52.675992 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 94/183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:52 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:52.685595 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:52.687006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1bed1e2d-f204-4e77-86ed-26abb360c02d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.351265 Aug 01 14:09:52.701606 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 90/184] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:52 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:52.781791 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c0d1e430-c743-4f43-a45d-7e0c06029973 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:52.782656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c0d1e430-c743-4f43-a45d-7e0c06029973 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:52.796359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c0d1e430-c743-4f43-a45d-7e0c06029973 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:52.796359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c0d1e430-c743-4f43-a45d-7e0c06029973 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:52.796359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c0d1e430-c743-4f43-a45d-7e0c06029973 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:52.796359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c0d1e430-c743-4f43-a45d-7e0c06029973 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:52.801405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:52.993051 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c0d1e430-c743-4f43-a45d-7e0c06029973 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:53.004597 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c0d1e430-c743-4f43-a45d-7e0c06029973 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.228429 Aug 01 14:09:53.006417 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 95/185] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:52 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:53.028333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-11ef459f-245e-4746-86dd-304770443cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:53.029300 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-11ef459f-245e-4746-86dd-304770443cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:53.043587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11ef459f-245e-4746-86dd-304770443cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:53.044777 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11ef459f-245e-4746-86dd-304770443cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:53.048129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11ef459f-245e-4746-86dd-304770443cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:53.048647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11ef459f-245e-4746-86dd-304770443cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:53.358446 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-11ef459f-245e-4746-86dd-304770443cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:53.370818 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-11ef459f-245e-4746-86dd-304770443cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.348715 Aug 01 14:09:53.372264 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 91/186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:53 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:53.705282 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6c7454a2-2b8f-4684-a699-3cdb1b09cc30 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:53.713746 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:53.715966 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6c7454a2-2b8f-4684-a699-3cdb1b09cc30 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:53.716696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:53.748895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c7454a2-2b8f-4684-a699-3cdb1b09cc30 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:53.749939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c7454a2-2b8f-4684-a699-3cdb1b09cc30 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:53.751136 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c7454a2-2b8f-4684-a699-3cdb1b09cc30 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:53.751944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c7454a2-2b8f-4684-a699-3cdb1b09cc30 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:53.761209 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:53.767971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:53.769051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:53.769497 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:53.987410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6c7454a2-2b8f-4684-a699-3cdb1b09cc30 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:53.998358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6c7454a2-2b8f-4684-a699-3cdb1b09cc30 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.298419 Aug 01 14:09:53.999346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 96/187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:53 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:54.032633 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ff7ab379-954f-4241-b9a8-76b7e0f20588 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:54.033531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ff7ab379-954f-4241-b9a8-76b7e0f20588 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:54.043581 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:54.046815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ff7ab379-954f-4241-b9a8-76b7e0f20588 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:54.055099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ff7ab379-954f-4241-b9a8-76b7e0f20588 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:54.056944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ff7ab379-954f-4241-b9a8-76b7e0f20588 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:54.058064 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ff7ab379-954f-4241-b9a8-76b7e0f20588 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:54.181798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:54.196936 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:54.198792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:54.200091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-40d51c07-239b-4a4f-a81d-4787e5a305fb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.492640 Aug 01 14:09:54.206479 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 92/188] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:53 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:54.291312 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ff7ab379-954f-4241-b9a8-76b7e0f20588 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:54.339232 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ff7ab379-954f-4241-b9a8-76b7e0f20588 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.308862 Aug 01 14:09:54.341634 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 97/189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:54 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:54.393321 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c58c4c7e-4664-4188-83a3-daa330aaac4e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:54.393920 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c58c4c7e-4664-4188-83a3-daa330aaac4e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:54.411825 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c58c4c7e-4664-4188-83a3-daa330aaac4e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:54.413075 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c58c4c7e-4664-4188-83a3-daa330aaac4e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:54.417638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c58c4c7e-4664-4188-83a3-daa330aaac4e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:54.419869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c58c4c7e-4664-4188-83a3-daa330aaac4e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:54.455594 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-d8e806f3-9fc8-471b-a813-0d4980dea4ca req-d4373593-daca-4f0f-b3c9-c6263cb6c03e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fd7ad6-9939-4561-b0fa-f45f8602eccf", "name": "network-vif-plugged", "status": "completed", "tag": "74f5404a-20d0-4b4a-8fec-5f4dbc58380a"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:54.484445 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d8e806f3-9fc8-471b-a813-0d4980dea4ca req-d4373593-daca-4f0f-b3c9-c6263cb6c03e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:54.486056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d8e806f3-9fc8-471b-a813-0d4980dea4ca req-d4373593-daca-4f0f-b3c9-c6263cb6c03e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:54.530558 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-d8e806f3-9fc8-471b-a813-0d4980dea4ca req-d4373593-daca-4f0f-b3c9-c6263cb6c03e service nova] Creating event network-vif-plugged:74f5404a-20d0-4b4a-8fec-5f4dbc58380a for instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf on hv-cinder-84713 Aug 01 14:09:54.548379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-d8e806f3-9fc8-471b-a813-0d4980dea4ca req-d4373593-daca-4f0f-b3c9-c6263cb6c03e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095516 Aug 01 14:09:54.550097 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 98/190] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:54.948573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c58c4c7e-4664-4188-83a3-daa330aaac4e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:54.964318 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c58c4c7e-4664-4188-83a3-daa330aaac4e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.575228 Aug 01 14:09:54.965158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 93/191] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:54 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:55.022603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bbbe5ccb-3cd0-443d-9815-518d5d6d4e0c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:55.024869 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bbbe5ccb-3cd0-443d-9815-518d5d6d4e0c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:55.038437 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbbe5ccb-3cd0-443d-9815-518d5d6d4e0c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.038894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbbe5ccb-3cd0-443d-9815-518d5d6d4e0c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:55.046556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbbe5ccb-3cd0-443d-9815-518d5d6d4e0c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.050102 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbbe5ccb-3cd0-443d-9815-518d5d6d4e0c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:55.231279 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:55.232424 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:55.241551 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.245002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:55.246184 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.247130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:55.267466 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bbbe5ccb-3cd0-443d-9815-518d5d6d4e0c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:55.278717 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bbbe5ccb-3cd0-443d-9815-518d5d6d4e0c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.262024 Aug 01 14:09:55.279294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 99/192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:55 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:55.365859 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ac0f6172-db02-4dbe-8a53-0f4bc70f5cf4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:55.367680 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ac0f6172-db02-4dbe-8a53-0f4bc70f5cf4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:55.381734 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ac0f6172-db02-4dbe-8a53-0f4bc70f5cf4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.382304 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ac0f6172-db02-4dbe-8a53-0f4bc70f5cf4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:55.384431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ac0f6172-db02-4dbe-8a53-0f4bc70f5cf4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.385697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ac0f6172-db02-4dbe-8a53-0f4bc70f5cf4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:55.524645 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:55.535530 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:55.540215 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:55.541394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-68b68196-3857-486c-a3a1-ebc99e5e0feb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.314514 Aug 01 14:09:55.560513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 94/193] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:55 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:55.587709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ac0f6172-db02-4dbe-8a53-0f4bc70f5cf4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:55.598495 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ac0f6172-db02-4dbe-8a53-0f4bc70f5cf4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.240398 Aug 01 14:09:55.613476 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 100/194] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:55 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:55.987375 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fde0e8ae-7cfc-4afb-86b9-46508d597bce tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:55.988357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fde0e8ae-7cfc-4afb-86b9-46508d597bce tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:55.994890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fde0e8ae-7cfc-4afb-86b9-46508d597bce tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.995511 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fde0e8ae-7cfc-4afb-86b9-46508d597bce tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:55.996336 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fde0e8ae-7cfc-4afb-86b9-46508d597bce tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:55.997062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fde0e8ae-7cfc-4afb-86b9-46508d597bce tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.138256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fde0e8ae-7cfc-4afb-86b9-46508d597bce tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:56.143387 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:56.150001 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fde0e8ae-7cfc-4afb-86b9-46508d597bce tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.167134 Aug 01 14:09:56.151079 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:55 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:56.300535 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3f81294a-db01-4dd5-9e15-a6300fb3a632 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:56.301778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3f81294a-db01-4dd5-9e15-a6300fb3a632 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:56.309403 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f81294a-db01-4dd5-9e15-a6300fb3a632 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:56.310288 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f81294a-db01-4dd5-9e15-a6300fb3a632 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.311219 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f81294a-db01-4dd5-9e15-a6300fb3a632 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:56.311804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f81294a-db01-4dd5-9e15-a6300fb3a632 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.518518 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3f81294a-db01-4dd5-9e15-a6300fb3a632 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:56.528595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3f81294a-db01-4dd5-9e15-a6300fb3a632 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.231255 Aug 01 14:09:56.541694 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 101/196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:56 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:56.567475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:56.568579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:56.581140 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-04e4f2b5-ba39-47ac-90e4-bc56a701c702 req-8034cd6d-d6cb-4760-b341-b5e8484a29c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cc4e77-f019-4285-ac19-c01b7c96a515", "name": "network-vif-plugged", "status": "completed", "tag": "07e3e2e9-2e5a-45dc-8c38-d0fda52efe94"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:09:56.581807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:56.582244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.583179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:56.584359 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.596461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-04e4f2b5-ba39-47ac-90e4-bc56a701c702 req-8034cd6d-d6cb-4760-b341-b5e8484a29c5 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:56.596929 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-04e4f2b5-ba39-47ac-90e4-bc56a701c702 req-8034cd6d-d6cb-4760-b341-b5e8484a29c5 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.614798 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-04e4f2b5-ba39-47ac-90e4-bc56a701c702 req-8034cd6d-d6cb-4760-b341-b5e8484a29c5 service nova] Creating event network-vif-plugged:07e3e2e9-2e5a-45dc-8c38-d0fda52efe94 for instance 78cc4e77-f019-4285-ac19-c01b7c96a515 on hv-cinder-84713 Aug 01 14:09:56.620394 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-04e4f2b5-ba39-47ac-90e4-bc56a701c702 req-8034cd6d-d6cb-4760-b341-b5e8484a29c5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043261 Aug 01 14:09:56.621061 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 102/197] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:09:56.626337 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-268bae5b-e9b9-45a0-b737-56b211d3d16b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:56.627086 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-268bae5b-e9b9-45a0-b737-56b211d3d16b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:56.634136 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-268bae5b-e9b9-45a0-b737-56b211d3d16b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:56.637085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-268bae5b-e9b9-45a0-b737-56b211d3d16b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.637085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-268bae5b-e9b9-45a0-b737-56b211d3d16b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:56.637085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-268bae5b-e9b9-45a0-b737-56b211d3d16b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:56.754645 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:56.769732 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:56.772365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:56.773807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b5c86fd6-e995-456d-8c9a-e46a74c5200d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.210784 Aug 01 14:09:56.774882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 96/198] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:56 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:56.817457 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-268bae5b-e9b9-45a0-b737-56b211d3d16b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:56.828509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-268bae5b-e9b9-45a0-b737-56b211d3d16b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.206043 Aug 01 14:09:56.829269 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 103/199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:56 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:57.170259 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-13463d7d-d6d0-4ad0-a136-1f939f64f468 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:57.171174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-13463d7d-d6d0-4ad0-a136-1f939f64f468 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:57.177968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13463d7d-d6d0-4ad0-a136-1f939f64f468 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.178824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13463d7d-d6d0-4ad0-a136-1f939f64f468 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:57.179605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13463d7d-d6d0-4ad0-a136-1f939f64f468 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.180536 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13463d7d-d6d0-4ad0-a136-1f939f64f468 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:57.330408 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-13463d7d-d6d0-4ad0-a136-1f939f64f468 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:57.337760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-13463d7d-d6d0-4ad0-a136-1f939f64f468 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.171329 Aug 01 14:09:57.351778 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 97/200] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:57 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:57.552055 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-12f041fb-2aae-448d-bb16-95706f40bc44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:57.553979 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-12f041fb-2aae-448d-bb16-95706f40bc44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:57.563586 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-12f041fb-2aae-448d-bb16-95706f40bc44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.564248 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-12f041fb-2aae-448d-bb16-95706f40bc44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:57.565205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-12f041fb-2aae-448d-bb16-95706f40bc44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.565922 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-12f041fb-2aae-448d-bb16-95706f40bc44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:57.716314 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-12f041fb-2aae-448d-bb16-95706f40bc44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:57.724084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-12f041fb-2aae-448d-bb16-95706f40bc44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.177680 Aug 01 14:09:57.725229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 104/201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:57 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:57.801416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:57.802026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:57.808211 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.808688 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:57.809463 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.809883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:57.853061 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-89529bc5-9899-4d7a-9317-344f4df560ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:57.854203 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-89529bc5-9899-4d7a-9317-344f4df560ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:57.862781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-89529bc5-9899-4d7a-9317-344f4df560ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.863404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-89529bc5-9899-4d7a-9317-344f4df560ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:57.864389 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-89529bc5-9899-4d7a-9317-344f4df560ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:57.865591 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-89529bc5-9899-4d7a-9317-344f4df560ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:58.019712 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:58.028371 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:58.030147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:58.031247 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6b01e52e-fbba-4ab2-9858-64d6f41744c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.233770 Aug 01 14:09:58.031806 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 98/202] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:57 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:09:58.124341 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-89529bc5-9899-4d7a-9317-344f4df560ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:58.134146 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-89529bc5-9899-4d7a-9317-344f4df560ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.286692 Aug 01 14:09:58.134775 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 105/203] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:57 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:58.358867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4fd5eb0c-118d-4ba0-bf1b-c6f99feada0f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:58.359471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4fd5eb0c-118d-4ba0-bf1b-c6f99feada0f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:58.365941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd5eb0c-118d-4ba0-bf1b-c6f99feada0f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:58.366382 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd5eb0c-118d-4ba0-bf1b-c6f99feada0f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:58.367134 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd5eb0c-118d-4ba0-bf1b-c6f99feada0f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:58.367564 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd5eb0c-118d-4ba0-bf1b-c6f99feada0f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:58.504153 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fd5eb0c-118d-4ba0-bf1b-c6f99feada0f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:58.513158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4fd5eb0c-118d-4ba0-bf1b-c6f99feada0f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.158000 Aug 01 14:09:58.513798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 99/204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:58 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:58.752213 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-274b5f96-b35d-41fd-9bac-070e0b923c9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:58.753054 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-274b5f96-b35d-41fd-9bac-070e0b923c9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:58.761333 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-274b5f96-b35d-41fd-9bac-070e0b923c9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:58.761568 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-274b5f96-b35d-41fd-9bac-070e0b923c9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:58.762448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-274b5f96-b35d-41fd-9bac-070e0b923c9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:58.762884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-274b5f96-b35d-41fd-9bac-070e0b923c9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:58.907179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-274b5f96-b35d-41fd-9bac-070e0b923c9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:58.915204 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-274b5f96-b35d-41fd-9bac-070e0b923c9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.173244 Aug 01 14:09:58.915866 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 106/205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:58 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:59.057282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:59.060589 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:59.066831 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:59.067292 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:59.068672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:59.069110 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:59.155858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-03332da4-387e-45c3-b0cb-69b23f2c6f00 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:59.156745 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-03332da4-387e-45c3-b0cb-69b23f2c6f00 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:59.163658 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-03332da4-387e-45c3-b0cb-69b23f2c6f00 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:59.164914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-03332da4-387e-45c3-b0cb-69b23f2c6f00 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:59.165844 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-03332da4-387e-45c3-b0cb-69b23f2c6f00 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:59.166431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-03332da4-387e-45c3-b0cb-69b23f2c6f00 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:59.220938 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:59.232656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:59.233845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:59.235129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-616f4447-d799-4d92-b677-134d3b4b7704 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.184897 Aug 01 14:09:59.236126 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 100/206] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:09:59 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:09:59.326278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-03332da4-387e-45c3-b0cb-69b23f2c6f00 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:59.333792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-03332da4-387e-45c3-b0cb-69b23f2c6f00 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.181699 Aug 01 14:09:59.334958 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 107/207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:59 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:59.533829 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a778245e-cfb9-4cf0-8f43-7f150c0faca7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:59.534363 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a778245e-cfb9-4cf0-8f43-7f150c0faca7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:59.540348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a778245e-cfb9-4cf0-8f43-7f150c0faca7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:59.540857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a778245e-cfb9-4cf0-8f43-7f150c0faca7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:59.541621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a778245e-cfb9-4cf0-8f43-7f150c0faca7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:59.542065 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a778245e-cfb9-4cf0-8f43-7f150c0faca7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:59.666339 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a778245e-cfb9-4cf0-8f43-7f150c0faca7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:09:59.673673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a778245e-cfb9-4cf0-8f43-7f150c0faca7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.143759 Aug 01 14:09:59.674240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 101/208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:59 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:59.936152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fc2d0864-7d8d-4867-a62e-fab17ca164f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:09:59.936795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fc2d0864-7d8d-4867-a62e-fab17ca164f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:09:59.943444 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fc2d0864-7d8d-4867-a62e-fab17ca164f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:59.943886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fc2d0864-7d8d-4867-a62e-fab17ca164f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:09:59.944667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fc2d0864-7d8d-4867-a62e-fab17ca164f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:09:59.945096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fc2d0864-7d8d-4867-a62e-fab17ca164f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:00.069937 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fc2d0864-7d8d-4867-a62e-fab17ca164f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:00.077358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fc2d0864-7d8d-4867-a62e-fab17ca164f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.144994 Aug 01 14:10:00.077926 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 108/209] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:09:59 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:00.260840 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:00.261442 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:00.267349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:00.267790 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:00.268565 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:00.268997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:00.355316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-03e680cf-be88-4c55-977e-3194c716ff70 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:00.356035 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-03e680cf-be88-4c55-977e-3194c716ff70 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:00.362326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-03e680cf-be88-4c55-977e-3194c716ff70 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:00.362776 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-03e680cf-be88-4c55-977e-3194c716ff70 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:00.363546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-03e680cf-be88-4c55-977e-3194c716ff70 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:00.363988 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-03e680cf-be88-4c55-977e-3194c716ff70 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:00.408780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:00.417200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:00.418886 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:00.419976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7b6c6d57-1999-4988-be57-97f260fda0a8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.163136 Aug 01 14:10:00.420559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 102/210] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:00 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:00.498217 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-03e680cf-be88-4c55-977e-3194c716ff70 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:00.506064 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-03e680cf-be88-4c55-977e-3194c716ff70 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.154058 Aug 01 14:10:00.506616 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 109/211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:00 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:00.696705 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-79575ee2-f3ab-49b7-8e7f-66a0a8152294 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:00.697315 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-79575ee2-f3ab-49b7-8e7f-66a0a8152294 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:00.703326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79575ee2-f3ab-49b7-8e7f-66a0a8152294 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:00.703778 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79575ee2-f3ab-49b7-8e7f-66a0a8152294 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:00.704561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79575ee2-f3ab-49b7-8e7f-66a0a8152294 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:00.705000 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79575ee2-f3ab-49b7-8e7f-66a0a8152294 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:00.830643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-79575ee2-f3ab-49b7-8e7f-66a0a8152294 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:00.839107 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-79575ee2-f3ab-49b7-8e7f-66a0a8152294 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.146905 Aug 01 14:10:00.839737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 103/212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:00 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:01.099078 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0705a21a-fa30-4c78-8d3f-e67516bec151 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:01.099685 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0705a21a-fa30-4c78-8d3f-e67516bec151 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:01.105680 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0705a21a-fa30-4c78-8d3f-e67516bec151 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:01.106121 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0705a21a-fa30-4c78-8d3f-e67516bec151 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.106876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0705a21a-fa30-4c78-8d3f-e67516bec151 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:01.107304 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0705a21a-fa30-4c78-8d3f-e67516bec151 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.238379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0705a21a-fa30-4c78-8d3f-e67516bec151 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:01.245981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0705a21a-fa30-4c78-8d3f-e67516bec151 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.150710 Aug 01 14:10:01.246731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 110/213] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:01 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:01.443307 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:01.443909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:01.449908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:01.450346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.451091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:01.451519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.526945 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c8d50f75-77a2-4175-8088-c72ae6a903c2 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:01.527547 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c8d50f75-77a2-4175-8088-c72ae6a903c2 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:01.533681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c8d50f75-77a2-4175-8088-c72ae6a903c2 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:01.534135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c8d50f75-77a2-4175-8088-c72ae6a903c2 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.534905 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c8d50f75-77a2-4175-8088-c72ae6a903c2 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:01.535346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c8d50f75-77a2-4175-8088-c72ae6a903c2 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.582863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:01.591404 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:01.593317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:01.594467 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0f470398-0dfa-4bf8-a73a-65f2374b098c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.155622 Aug 01 14:10:01.595037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 104/214] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:01 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:01.669832 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c8d50f75-77a2-4175-8088-c72ae6a903c2 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:01.677813 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c8d50f75-77a2-4175-8088-c72ae6a903c2 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.154208 Aug 01 14:10:01.678381 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 111/215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:01 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:01.860633 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c557468b-1c63-40d5-87b3-aca077306df1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:01.861253 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c557468b-1c63-40d5-87b3-aca077306df1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:01.867463 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c557468b-1c63-40d5-87b3-aca077306df1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:01.867942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c557468b-1c63-40d5-87b3-aca077306df1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.868767 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c557468b-1c63-40d5-87b3-aca077306df1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:01.869200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c557468b-1c63-40d5-87b3-aca077306df1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:01.996296 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c557468b-1c63-40d5-87b3-aca077306df1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:02.003852 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c557468b-1c63-40d5-87b3-aca077306df1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.147048 Aug 01 14:10:02.004411 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 105/216] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:01 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:02.267491 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-22a38974-d26a-4476-bf29-2b47bff4ed84 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:02.268105 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-22a38974-d26a-4476-bf29-2b47bff4ed84 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:02.274346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22a38974-d26a-4476-bf29-2b47bff4ed84 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:02.274804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22a38974-d26a-4476-bf29-2b47bff4ed84 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:02.275574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22a38974-d26a-4476-bf29-2b47bff4ed84 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:02.276056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22a38974-d26a-4476-bf29-2b47bff4ed84 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:02.403242 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-22a38974-d26a-4476-bf29-2b47bff4ed84 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:02.410925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-22a38974-d26a-4476-bf29-2b47bff4ed84 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.147226 Aug 01 14:10:02.411496 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 112/217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:02 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:02.615861 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:02.616470 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:02.622514 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:02.622961 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:02.623715 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:02.624147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:02.699375 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9db6c5a4-95c3-4e1a-9d72-c188f8c35f8c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:02.699629 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9db6c5a4-95c3-4e1a-9d72-c188f8c35f8c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:02.705623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9db6c5a4-95c3-4e1a-9d72-c188f8c35f8c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:02.706072 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9db6c5a4-95c3-4e1a-9d72-c188f8c35f8c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:02.706838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9db6c5a4-95c3-4e1a-9d72-c188f8c35f8c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:02.707278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9db6c5a4-95c3-4e1a-9d72-c188f8c35f8c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:02.711936 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.750841 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:02.759371 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:02.760889 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:02.761987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-70832d52-3af1-4ca4-a82a-e0e9c3d2fe51 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.150035 Aug 01 14:10:02.762540 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 106/218] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:02 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:02.835995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9db6c5a4-95c3-4e1a-9d72-c188f8c35f8c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:02.843604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9db6c5a4-95c3-4e1a-9d72-c188f8c35f8c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.148472 Aug 01 14:10:02.844167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 113/219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:02 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:03.025262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ebbf5713-4af5-48d0-9be3-cb5a880f221c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:03.025875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ebbf5713-4af5-48d0-9be3-cb5a880f221c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:03.031882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebbf5713-4af5-48d0-9be3-cb5a880f221c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:03.032364 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebbf5713-4af5-48d0-9be3-cb5a880f221c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:03.033105 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebbf5713-4af5-48d0-9be3-cb5a880f221c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:03.033530 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebbf5713-4af5-48d0-9be3-cb5a880f221c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:03.165548 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ebbf5713-4af5-48d0-9be3-cb5a880f221c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:03.172836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ebbf5713-4af5-48d0-9be3-cb5a880f221c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.151536 Aug 01 14:10:03.173454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 107/220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:03 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:03.431356 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5594262f-e3c9-4a86-99fd-e21e8c6beb2a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:03.431984 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5594262f-e3c9-4a86-99fd-e21e8c6beb2a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:03.437963 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5594262f-e3c9-4a86-99fd-e21e8c6beb2a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:03.438412 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5594262f-e3c9-4a86-99fd-e21e8c6beb2a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:03.439205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5594262f-e3c9-4a86-99fd-e21e8c6beb2a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:03.439642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5594262f-e3c9-4a86-99fd-e21e8c6beb2a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:03.571441 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5594262f-e3c9-4a86-99fd-e21e8c6beb2a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:03.579140 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5594262f-e3c9-4a86-99fd-e21e8c6beb2a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.152143 Aug 01 14:10:03.579684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 114/221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:03 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:03.784067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:03.784713 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:03.790730 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:03.791181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:03.791955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:03.792375 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:03.864347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-54deda08-cfd9-421b-b08c-557ef068ac6b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:03.865529 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-54deda08-cfd9-421b-b08c-557ef068ac6b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:03.871549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-54deda08-cfd9-421b-b08c-557ef068ac6b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:03.871965 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-54deda08-cfd9-421b-b08c-557ef068ac6b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:03.872779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-54deda08-cfd9-421b-b08c-557ef068ac6b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:03.873207 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-54deda08-cfd9-421b-b08c-557ef068ac6b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:03.924952 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:03.936909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:03.938546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:03.939724 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b837879f-4839-49fe-862d-b5a7b8f9858d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.159573 Aug 01 14:10:03.940439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 108/222] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:03 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:04.004271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-54deda08-cfd9-421b-b08c-557ef068ac6b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:04.011705 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-54deda08-cfd9-421b-b08c-557ef068ac6b tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.151413 Aug 01 14:10:04.012274 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 115/223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:03 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:04.194104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b64d6dc3-5ffe-4a00-8486-d60edd9d2c21 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:04.194714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b64d6dc3-5ffe-4a00-8486-d60edd9d2c21 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:04.200773 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b64d6dc3-5ffe-4a00-8486-d60edd9d2c21 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:04.201217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b64d6dc3-5ffe-4a00-8486-d60edd9d2c21 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:04.201976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b64d6dc3-5ffe-4a00-8486-d60edd9d2c21 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:04.202408 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b64d6dc3-5ffe-4a00-8486-d60edd9d2c21 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:04.334961 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b64d6dc3-5ffe-4a00-8486-d60edd9d2c21 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:04.342759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b64d6dc3-5ffe-4a00-8486-d60edd9d2c21 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.152975 Aug 01 14:10:04.343330 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 109/224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:04 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:04.600230 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4c4651ec-2ed7-4a81-b9ea-7cfd6597799f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:04.600868 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4c4651ec-2ed7-4a81-b9ea-7cfd6597799f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:04.606809 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4c4651ec-2ed7-4a81-b9ea-7cfd6597799f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:04.607260 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4c4651ec-2ed7-4a81-b9ea-7cfd6597799f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:04.608016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4c4651ec-2ed7-4a81-b9ea-7cfd6597799f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:04.608451 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4c4651ec-2ed7-4a81-b9ea-7cfd6597799f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:04.735402 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4c4651ec-2ed7-4a81-b9ea-7cfd6597799f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:04.743517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4c4651ec-2ed7-4a81-b9ea-7cfd6597799f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.147046 Aug 01 14:10:04.744088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 116/225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:04 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:04.962999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:04.963661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:04.969954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:04.970399 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:04.971158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:04.971594 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:05.035488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c87214f7-108d-4904-ba1a-ca39d615e57c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:05.036368 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c87214f7-108d-4904-ba1a-ca39d615e57c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:05.043430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c87214f7-108d-4904-ba1a-ca39d615e57c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:05.044060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c87214f7-108d-4904-ba1a-ca39d615e57c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:05.045021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c87214f7-108d-4904-ba1a-ca39d615e57c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:05.045585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c87214f7-108d-4904-ba1a-ca39d615e57c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:05.110768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:05.118899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:05.120548 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:05.121730 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6addf55e-62fa-40a8-b4f4-0af7a58ca05c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1407 microversion: 2.20 time: 0.162658 Aug 01 14:10:05.122362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 110/226] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:04 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:05.178267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c87214f7-108d-4904-ba1a-ca39d615e57c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:05.185601 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c87214f7-108d-4904-ba1a-ca39d615e57c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.156002 Aug 01 14:10:05.186164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 117/227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:05 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:05.363313 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f727e3c7-6951-4436-9e44-683651186b27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:05.363951 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f727e3c7-6951-4436-9e44-683651186b27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:05.370189 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f727e3c7-6951-4436-9e44-683651186b27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:05.370656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f727e3c7-6951-4436-9e44-683651186b27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:05.371439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f727e3c7-6951-4436-9e44-683651186b27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:05.371896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f727e3c7-6951-4436-9e44-683651186b27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:05.511341 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f727e3c7-6951-4436-9e44-683651186b27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:05.519838 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f727e3c7-6951-4436-9e44-683651186b27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.160407 Aug 01 14:10:05.520418 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 111/228] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:05 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:05.764112 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-429b5118-5dec-4bf7-a7bb-461ef15aac5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:05.764737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-429b5118-5dec-4bf7-a7bb-461ef15aac5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:05.770739 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-429b5118-5dec-4bf7-a7bb-461ef15aac5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:05.771188 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-429b5118-5dec-4bf7-a7bb-461ef15aac5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:05.772609 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-429b5118-5dec-4bf7-a7bb-461ef15aac5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:05.773042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-429b5118-5dec-4bf7-a7bb-461ef15aac5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:05.918097 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-429b5118-5dec-4bf7-a7bb-461ef15aac5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:05.925664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-429b5118-5dec-4bf7-a7bb-461ef15aac5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1321 microversion: 2.1 time: 0.165416 Aug 01 14:10:05.926238 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 118/229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:05 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:06.145772 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:06.146408 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:06.152410 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.152903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.153664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.154100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.172727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:06.205882 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-22f905c0-bd31-41f5-919d-4e1f16a6b9ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:06.206496 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-22f905c0-bd31-41f5-919d-4e1f16a6b9ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:06.214404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22f905c0-bd31-41f5-919d-4e1f16a6b9ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.214404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22f905c0-bd31-41f5-919d-4e1f16a6b9ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.214404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22f905c0-bd31-41f5-919d-4e1f16a6b9ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.214716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22f905c0-bd31-41f5-919d-4e1f16a6b9ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.306492 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:06.317505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:06.319181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:06.324808 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d06082f3-b46f-4e37-b6e4-5cce266f120c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1600 microversion: 2.20 time: 0.181371 Aug 01 14:10:06.339089 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 112/230] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:10:06 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1600 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:10:06.351164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-56881291-3984-4800-946f-fe28bda5083d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:06.351592 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-56881291-3984-4800-946f-fe28bda5083d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:06.357955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56881291-3984-4800-946f-fe28bda5083d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.358402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56881291-3984-4800-946f-fe28bda5083d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.359162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56881291-3984-4800-946f-fe28bda5083d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.359592 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56881291-3984-4800-946f-fe28bda5083d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.364610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-22f905c0-bd31-41f5-919d-4e1f16a6b9ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:06.372770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-22f905c0-bd31-41f5-919d-4e1f16a6b9ed tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.171023 Aug 01 14:10:06.373347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 119/231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:06 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:06.471955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-56881291-3984-4800-946f-fe28bda5083d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.125643 Aug 01 14:10:06.472568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 113/232] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Aug 1 14:10:06 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:06.541661 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-082b80ba-9153-473c-b1db-fb951f2e87e6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:06.542369 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-082b80ba-9153-473c-b1db-fb951f2e87e6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:06.548581 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-082b80ba-9153-473c-b1db-fb951f2e87e6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.549108 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-082b80ba-9153-473c-b1db-fb951f2e87e6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.550574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-082b80ba-9153-473c-b1db-fb951f2e87e6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.551347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-082b80ba-9153-473c-b1db-fb951f2e87e6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.947255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-146209fe-72e1-410c-93d2-5fa777278b06 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:06.947872 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-146209fe-72e1-410c-93d2-5fa777278b06 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:06.954271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-146209fe-72e1-410c-93d2-5fa777278b06 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.954725 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-146209fe-72e1-410c-93d2-5fa777278b06 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:06.955502 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-146209fe-72e1-410c-93d2-5fa777278b06 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:06.955938 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-146209fe-72e1-410c-93d2-5fa777278b06 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.002266 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-082b80ba-9153-473c-b1db-fb951f2e87e6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:07.010420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-082b80ba-9153-473c-b1db-fb951f2e87e6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.473159 Aug 01 14:10:07.010990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 120/233] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:06 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:07.105498 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-146209fe-72e1-410c-93d2-5fa777278b06 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:07.112975 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-146209fe-72e1-410c-93d2-5fa777278b06 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1516 microversion: 2.1 time: 0.170371 Aug 01 14:10:07.113593 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 114/234] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:06 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1516 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:07.135312 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-75306215-740c-424b-a104-a43bdd5ca73e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:07.138026 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-75306215-740c-424b-a104-a43bdd5ca73e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:07.154434 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-75306215-740c-424b-a104-a43bdd5ca73e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:07.154885 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-75306215-740c-424b-a104-a43bdd5ca73e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.155659 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-75306215-740c-424b-a104-a43bdd5ca73e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:07.157993 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-75306215-740c-424b-a104-a43bdd5ca73e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.224579 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-75306215-740c-424b-a104-a43bdd5ca73e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lazy-loading 'flavor' on Instance uuid 8437bc61-6b11-4e15-afb8-f748b55a9e06 {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:10:07.353715 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-75306215-740c-424b-a104-a43bdd5ca73e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06/action" status: 200 len: 32 microversion: 2.1 time: 0.222886 Aug 01 14:10:07.354373 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 121/235] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:10:07 2022] POST /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:10:07.365785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-618291bd-54db-49c0-96eb-91cef8e9a0f8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:07.367010 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-618291bd-54db-49c0-96eb-91cef8e9a0f8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:07.373865 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-618291bd-54db-49c0-96eb-91cef8e9a0f8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:07.374565 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-618291bd-54db-49c0-96eb-91cef8e9a0f8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.375617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-618291bd-54db-49c0-96eb-91cef8e9a0f8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:07.376248 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-618291bd-54db-49c0-96eb-91cef8e9a0f8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.395042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a8756681-e2db-4742-bf6f-b72ccac76f3f tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:07.396302 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a8756681-e2db-4742-bf6f-b72ccac76f3f tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:07.407327 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8756681-e2db-4742-bf6f-b72ccac76f3f tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:07.407923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8756681-e2db-4742-bf6f-b72ccac76f3f tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.408935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8756681-e2db-4742-bf6f-b72ccac76f3f tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:07.409760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8756681-e2db-4742-bf6f-b72ccac76f3f tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:07.580040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-618291bd-54db-49c0-96eb-91cef8e9a0f8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:07.589438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-618291bd-54db-49c0-96eb-91cef8e9a0f8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.227984 Aug 01 14:10:07.591848 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 115/236] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:07 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:07.701343 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a8756681-e2db-4742-bf6f-b72ccac76f3f tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:07.717144 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a8756681-e2db-4742-bf6f-b72ccac76f3f tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.326200 Aug 01 14:10:07.725583 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 122/237] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:07 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:08.031585 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8966e75-4a2a-42fc-91e4-6f5c1818014a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:08.032188 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d8966e75-4a2a-42fc-91e4-6f5c1818014a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:08.039274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8966e75-4a2a-42fc-91e4-6f5c1818014a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.039913 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8966e75-4a2a-42fc-91e4-6f5c1818014a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:08.040903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8966e75-4a2a-42fc-91e4-6f5c1818014a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.041707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8966e75-4a2a-42fc-91e4-6f5c1818014a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:08.097020 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-9b756a9f-d6c7-49fb-bf66-e1b85e253562 req-baeebbe9-95ff-405a-8360-b3494635edbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51fd7ad6-9939-4561-b0fa-f45f8602eccf", "tag": "74f5404a-20d0-4b4a-8fec-5f4dbc58380a"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:08.107066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-9b756a9f-d6c7-49fb-bf66-e1b85e253562 req-baeebbe9-95ff-405a-8360-b3494635edbe service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.107510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-9b756a9f-d6c7-49fb-bf66-e1b85e253562 req-baeebbe9-95ff-405a-8360-b3494635edbe service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:08.119534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-9b756a9f-d6c7-49fb-bf66-e1b85e253562 req-baeebbe9-95ff-405a-8360-b3494635edbe service nova] Creating event network-changed:74f5404a-20d0-4b4a-8fec-5f4dbc58380a for instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf on hv-cinder-84713 Aug 01 14:10:08.124882 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-9b756a9f-d6c7-49fb-bf66-e1b85e253562 req-baeebbe9-95ff-405a-8360-b3494635edbe service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031693 Aug 01 14:10:08.125785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 123/238] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:08.265364 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d8966e75-4a2a-42fc-91e4-6f5c1818014a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:08.278398 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d8966e75-4a2a-42fc-91e4-6f5c1818014a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.250008 Aug 01 14:10:08.292267 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 116/239] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:08 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:08.611429 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e1976203-95b3-482a-a09e-00dcdd2cdf31 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:08.612229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e1976203-95b3-482a-a09e-00dcdd2cdf31 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:08.620424 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e1976203-95b3-482a-a09e-00dcdd2cdf31 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.621351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e1976203-95b3-482a-a09e-00dcdd2cdf31 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:08.622436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e1976203-95b3-482a-a09e-00dcdd2cdf31 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.623078 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e1976203-95b3-482a-a09e-00dcdd2cdf31 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:08.738364 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-85e239cc-5261-4ae9-9a61-f03842a7fec7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:08.739562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-85e239cc-5261-4ae9-9a61-f03842a7fec7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:08.748777 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e239cc-5261-4ae9-9a61-f03842a7fec7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.749468 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e239cc-5261-4ae9-9a61-f03842a7fec7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:08.750434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e239cc-5261-4ae9-9a61-f03842a7fec7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:08.751222 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85e239cc-5261-4ae9-9a61-f03842a7fec7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:08.815252 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e1976203-95b3-482a-a09e-00dcdd2cdf31 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:08.825870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e1976203-95b3-482a-a09e-00dcdd2cdf31 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.218548 Aug 01 14:10:08.826642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 124/240] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:08 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:08.937509 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-85e239cc-5261-4ae9-9a61-f03842a7fec7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:08.949996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-85e239cc-5261-4ae9-9a61-f03842a7fec7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.215772 Aug 01 14:10:08.951067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 117/241] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:08 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:09.299133 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f09477ad-f625-45ce-b2ac-2eb7e2f9311f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:09.299743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f09477ad-f625-45ce-b2ac-2eb7e2f9311f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:09.309514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f09477ad-f625-45ce-b2ac-2eb7e2f9311f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:09.309962 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f09477ad-f625-45ce-b2ac-2eb7e2f9311f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:09.310763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f09477ad-f625-45ce-b2ac-2eb7e2f9311f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:09.311192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f09477ad-f625-45ce-b2ac-2eb7e2f9311f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:09.467775 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f09477ad-f625-45ce-b2ac-2eb7e2f9311f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:09.477146 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f09477ad-f625-45ce-b2ac-2eb7e2f9311f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.181706 Aug 01 14:10:09.477988 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 125/242] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:09 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:09.850486 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cf1198e5-5f24-4ff1-9f62-3499e8e048ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:09.851606 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cf1198e5-5f24-4ff1-9f62-3499e8e048ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:09.859832 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf1198e5-5f24-4ff1-9f62-3499e8e048ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:09.860433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf1198e5-5f24-4ff1-9f62-3499e8e048ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:09.861117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf1198e5-5f24-4ff1-9f62-3499e8e048ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:09.861554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf1198e5-5f24-4ff1-9f62-3499e8e048ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:09.975818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1c587faa-88bb-497a-9786-890931eac819 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:09.976440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1c587faa-88bb-497a-9786-890931eac819 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:09.983392 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1c587faa-88bb-497a-9786-890931eac819 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:09.983854 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1c587faa-88bb-497a-9786-890931eac819 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:09.984772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1c587faa-88bb-497a-9786-890931eac819 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:09.985104 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1c587faa-88bb-497a-9786-890931eac819 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:10.008963 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cf1198e5-5f24-4ff1-9f62-3499e8e048ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:10.016620 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cf1198e5-5f24-4ff1-9f62-3499e8e048ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.172801 Aug 01 14:10:10.017251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 118/243] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:09 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:10.122348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1c587faa-88bb-497a-9786-890931eac819 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:10.130026 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1c587faa-88bb-497a-9786-890931eac819 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1315 microversion: 2.1 time: 0.160711 Aug 01 14:10:10.131225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 126/244] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:09 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:10.498484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9074e2b2-696a-4cfe-b081-5e4cdd8a8f5c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:10.499094 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9074e2b2-696a-4cfe-b081-5e4cdd8a8f5c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:10.504991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9074e2b2-696a-4cfe-b081-5e4cdd8a8f5c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:10.505506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9074e2b2-696a-4cfe-b081-5e4cdd8a8f5c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:10.506783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9074e2b2-696a-4cfe-b081-5e4cdd8a8f5c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:10.507218 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9074e2b2-696a-4cfe-b081-5e4cdd8a8f5c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:10.636687 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9074e2b2-696a-4cfe-b081-5e4cdd8a8f5c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:10.644257 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9074e2b2-696a-4cfe-b081-5e4cdd8a8f5c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.149699 Aug 01 14:10:10.644917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 119/245] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:10 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:11.037874 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4d1fa2e7-f506-4502-8bc2-33c184687aed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:11.038484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4d1fa2e7-f506-4502-8bc2-33c184687aed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:11.044334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d1fa2e7-f506-4502-8bc2-33c184687aed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:11.044831 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d1fa2e7-f506-4502-8bc2-33c184687aed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:11.045608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d1fa2e7-f506-4502-8bc2-33c184687aed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:11.046036 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d1fa2e7-f506-4502-8bc2-33c184687aed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:11.155369 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-32d12ff2-867f-44cd-9479-7025313da3c0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:11.156100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-32d12ff2-867f-44cd-9479-7025313da3c0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:11.163148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32d12ff2-867f-44cd-9479-7025313da3c0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:11.163586 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32d12ff2-867f-44cd-9479-7025313da3c0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:11.164586 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32d12ff2-867f-44cd-9479-7025313da3c0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:11.165222 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32d12ff2-867f-44cd-9479-7025313da3c0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:11.178374 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4d1fa2e7-f506-4502-8bc2-33c184687aed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:11.186032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4d1fa2e7-f506-4502-8bc2-33c184687aed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.152361 Aug 01 14:10:11.186595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 127/246] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:11 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:11.300351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-32d12ff2-867f-44cd-9479-7025313da3c0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:11.308094 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-32d12ff2-867f-44cd-9479-7025313da3c0 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1503 microversion: 2.1 time: 0.157143 Aug 01 14:10:11.308717 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 120/247] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:11 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:11.664896 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1f1bbb7a-b365-41d9-8580-db55450c201c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:11.665515 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1f1bbb7a-b365-41d9-8580-db55450c201c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:11.671382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1f1bbb7a-b365-41d9-8580-db55450c201c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:11.672116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1f1bbb7a-b365-41d9-8580-db55450c201c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:11.672915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1f1bbb7a-b365-41d9-8580-db55450c201c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:11.673350 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1f1bbb7a-b365-41d9-8580-db55450c201c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:11.690789 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:11.803865 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1f1bbb7a-b365-41d9-8580-db55450c201c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:11.811281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1f1bbb7a-b365-41d9-8580-db55450c201c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.150188 Aug 01 14:10:11.811920 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 128/248] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:11 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:12.206474 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f696a28b-b03c-499d-9596-f5e112384557 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:12.207096 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f696a28b-b03c-499d-9596-f5e112384557 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:12.213248 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f696a28b-b03c-499d-9596-f5e112384557 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:12.214223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f696a28b-b03c-499d-9596-f5e112384557 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:12.215435 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f696a28b-b03c-499d-9596-f5e112384557 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:12.215856 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f696a28b-b03c-499d-9596-f5e112384557 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:12.507631 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f696a28b-b03c-499d-9596-f5e112384557 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:12.515791 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f696a28b-b03c-499d-9596-f5e112384557 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.313123 Aug 01 14:10:12.516450 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 121/249] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:12 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:12.832426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c4abc1f2-8a5d-47da-9a7e-a832f8922b14 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:12.833058 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c4abc1f2-8a5d-47da-9a7e-a832f8922b14 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:12.839100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c4abc1f2-8a5d-47da-9a7e-a832f8922b14 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:12.839533 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c4abc1f2-8a5d-47da-9a7e-a832f8922b14 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:12.840281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c4abc1f2-8a5d-47da-9a7e-a832f8922b14 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:12.840737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c4abc1f2-8a5d-47da-9a7e-a832f8922b14 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:12.965838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c4abc1f2-8a5d-47da-9a7e-a832f8922b14 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:12.973465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c4abc1f2-8a5d-47da-9a7e-a832f8922b14 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.144749 Aug 01 14:10:12.974550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 129/250] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:12 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:13.536007 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3b421575-d3f0-4cb4-921e-ad2dae64916e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:13.536680 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3b421575-d3f0-4cb4-921e-ad2dae64916e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:13.542837 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3b421575-d3f0-4cb4-921e-ad2dae64916e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:13.543292 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3b421575-d3f0-4cb4-921e-ad2dae64916e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:13.544062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3b421575-d3f0-4cb4-921e-ad2dae64916e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:13.544519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3b421575-d3f0-4cb4-921e-ad2dae64916e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:13.710394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3b421575-d3f0-4cb4-921e-ad2dae64916e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:13.721617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3b421575-d3f0-4cb4-921e-ad2dae64916e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.189393 Aug 01 14:10:13.722355 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 122/251] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:13 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:13.994497 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a8c10d0a-9615-4eba-9567-0b2115e8c606 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:13.995112 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a8c10d0a-9615-4eba-9567-0b2115e8c606 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:14.001327 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8c10d0a-9615-4eba-9567-0b2115e8c606 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:14.001775 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8c10d0a-9615-4eba-9567-0b2115e8c606 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:14.002535 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8c10d0a-9615-4eba-9567-0b2115e8c606 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:14.002971 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8c10d0a-9615-4eba-9567-0b2115e8c606 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:14.375186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a8c10d0a-9615-4eba-9567-0b2115e8c606 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:14.383232 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a8c10d0a-9615-4eba-9567-0b2115e8c606 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1366 microversion: 2.1 time: 0.392586 Aug 01 14:10:14.383917 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 130/252] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:13 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:14.743230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-22cee2cb-b601-41e2-9790-fb8beeddfd09 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:14.743975 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-22cee2cb-b601-41e2-9790-fb8beeddfd09 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:14.750038 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22cee2cb-b601-41e2-9790-fb8beeddfd09 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:14.750483 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22cee2cb-b601-41e2-9790-fb8beeddfd09 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:14.751231 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22cee2cb-b601-41e2-9790-fb8beeddfd09 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:14.751660 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22cee2cb-b601-41e2-9790-fb8beeddfd09 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:14.825643 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4208710b-d842-49be-8640-3f2c12ce69b7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee50d895-b415-47d9-a557-0ae3ddddcba5"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:14.828283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4208710b-d842-49be-8640-3f2c12ce69b7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:14.835844 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4208710b-d842-49be-8640-3f2c12ce69b7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:14.836538 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4208710b-d842-49be-8640-3f2c12ce69b7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:14.837534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4208710b-d842-49be-8640-3f2c12ce69b7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:14.838220 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4208710b-d842-49be-8640-3f2c12ce69b7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:14.922495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-22cee2cb-b601-41e2-9790-fb8beeddfd09 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:14.937619 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-22cee2cb-b601-41e2-9790-fb8beeddfd09 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.198229 Aug 01 14:10:14.938397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 123/253] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:14 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:15.407228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-afd4fd05-cab7-4f7c-b411-0e04f584fd5e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:15.408164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-afd4fd05-cab7-4f7c-b411-0e04f584fd5e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:15.415638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afd4fd05-cab7-4f7c-b411-0e04f584fd5e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:15.416119 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afd4fd05-cab7-4f7c-b411-0e04f584fd5e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:15.416948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afd4fd05-cab7-4f7c-b411-0e04f584fd5e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:15.417546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afd4fd05-cab7-4f7c-b411-0e04f584fd5e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:15.562634 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-afd4fd05-cab7-4f7c-b411-0e04f584fd5e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:15.570283 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-afd4fd05-cab7-4f7c-b411-0e04f584fd5e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1556 microversion: 2.1 time: 0.168141 Aug 01 14:10:15.571028 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 124/254] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:15 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1556 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:15.599179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3112b3c3-da0a-4033-bde0-9a51c10be627 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:15.599681 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3112b3c3-da0a-4033-bde0-9a51c10be627 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:15.606844 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3112b3c3-da0a-4033-bde0-9a51c10be627 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:15.607296 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3112b3c3-da0a-4033-bde0-9a51c10be627 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:15.608083 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3112b3c3-da0a-4033-bde0-9a51c10be627 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:15.608557 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3112b3c3-da0a-4033-bde0-9a51c10be627 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:15.701323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3112b3c3-da0a-4033-bde0-9a51c10be627 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110874 Aug 01 14:10:15.711500 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 125/255] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 14:10:15 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:10:15.912589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4208710b-d842-49be-8640-3f2c12ce69b7 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "POST /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.090076 Aug 01 14:10:15.914259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 131/256] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:10:14 2022] POST /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3/os-volume_attachments => generated 194 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:15.961389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-241cb446-f7c7-414a-854a-c85805bca1ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:15.961919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-241cb446-f7c7-414a-854a-c85805bca1ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:15.970358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-241cb446-f7c7-414a-854a-c85805bca1ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:15.971058 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-241cb446-f7c7-414a-854a-c85805bca1ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:15.972335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-241cb446-f7c7-414a-854a-c85805bca1ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:15.972803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-241cb446-f7c7-414a-854a-c85805bca1ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:16.135523 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-241cb446-f7c7-414a-854a-c85805bca1ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:16.144120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-241cb446-f7c7-414a-854a-c85805bca1ff tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.187627 Aug 01 14:10:16.144822 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 126/257] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:15 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:16.841998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-d0d20c41-3c36-40e5-8949-d4faa78a5157 req-b38f53a6-c8c8-4973-94da-68395337a4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78cc4e77-f019-4285-ac19-c01b7c96a515", "tag": "07e3e2e9-2e5a-45dc-8c38-d0fda52efe94"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:16.856455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d0d20c41-3c36-40e5-8949-d4faa78a5157 req-b38f53a6-c8c8-4973-94da-68395337a4fb service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:16.867116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d0d20c41-3c36-40e5-8949-d4faa78a5157 req-b38f53a6-c8c8-4973-94da-68395337a4fb service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:16.880566 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-d0d20c41-3c36-40e5-8949-d4faa78a5157 req-b38f53a6-c8c8-4973-94da-68395337a4fb service nova] Creating event network-changed:07e3e2e9-2e5a-45dc-8c38-d0fda52efe94 for instance 78cc4e77-f019-4285-ac19-c01b7c96a515 on hv-cinder-84713 Aug 01 14:10:16.885861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-d0d20c41-3c36-40e5-8949-d4faa78a5157 req-b38f53a6-c8c8-4973-94da-68395337a4fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049068 Aug 01 14:10:16.887130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 132/258] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:17.169525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-29274453-9cd8-415f-9f4a-75a5daf4e180 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:17.170444 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-29274453-9cd8-415f-9f4a-75a5daf4e180 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:17.182537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-29274453-9cd8-415f-9f4a-75a5daf4e180 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:17.183261 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-29274453-9cd8-415f-9f4a-75a5daf4e180 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:17.188123 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-29274453-9cd8-415f-9f4a-75a5daf4e180 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:17.188845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-29274453-9cd8-415f-9f4a-75a5daf4e180 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:17.497088 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-29274453-9cd8-415f-9f4a-75a5daf4e180 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:17.507072 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-29274453-9cd8-415f-9f4a-75a5daf4e180 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.342601 Aug 01 14:10:17.508166 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 127/259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:17 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:18.532395 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-30a6a11b-dec1-465d-becc-9c4853281ec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:18.533403 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-30a6a11b-dec1-465d-becc-9c4853281ec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:18.544915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6a11b-dec1-465d-becc-9c4853281ec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:18.545660 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6a11b-dec1-465d-becc-9c4853281ec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:18.546994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6a11b-dec1-465d-becc-9c4853281ec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:18.547970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6a11b-dec1-465d-becc-9c4853281ec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:18.797498 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-30a6a11b-dec1-465d-becc-9c4853281ec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:18.805945 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-30a6a11b-dec1-465d-becc-9c4853281ec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.279768 Aug 01 14:10:18.807035 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 133/260] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:18 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:19.827371 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c53e723e-ea00-46ad-93e4-55d65a474a63 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:19.827994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c53e723e-ea00-46ad-93e4-55d65a474a63 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:19.833434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=86 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:19.835491 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c53e723e-ea00-46ad-93e4-55d65a474a63 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:19.836112 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c53e723e-ea00-46ad-93e4-55d65a474a63 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:19.837242 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c53e723e-ea00-46ad-93e4-55d65a474a63 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:19.837834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c53e723e-ea00-46ad-93e4-55d65a474a63 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:20.046217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c53e723e-ea00-46ad-93e4-55d65a474a63 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:20.056507 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c53e723e-ea00-46ad-93e4-55d65a474a63 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.233050 Aug 01 14:10:20.064713 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 128/261] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:19 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:20.604178 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1112126717", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:20.697994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] validate_networks() for None {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:10:21.077476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fb993d38-54cc-41ef-a1b8-27b6029da26c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:21.078242 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb993d38-54cc-41ef-a1b8-27b6029da26c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:21.089881 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb993d38-54cc-41ef-a1b8-27b6029da26c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:21.090175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb993d38-54cc-41ef-a1b8-27b6029da26c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:21.091221 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb993d38-54cc-41ef-a1b8-27b6029da26c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:21.091663 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb993d38-54cc-41ef-a1b8-27b6029da26c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:21.169794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:10:21.170141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:10:21.170616 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:10:21.171028 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:10:21.171458 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:10:21.196972 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:21.197651 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:21.198592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:21.199175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:21.221653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Getting quotas for project d0cc00c61d3e4e59b5790c99c6277d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:21.227961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Getting quotas for user 7f415b2218694e828b0d160dfce5e114 and project d0cc00c61d3e4e59b5790c99c6277d2d. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:21.260955 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:10:21.264742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:10:21.326926 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb993d38-54cc-41ef-a1b8-27b6029da26c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:21.333191 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:21.337805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dbc2abe0-877f-44e7-947f-935646975d81 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737487 Aug 01 14:10:21.338505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fb993d38-54cc-41ef-a1b8-27b6029da26c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.264837 Aug 01 14:10:21.344712 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 134/262] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:10:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:10:21.345737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 129/263] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:21 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:21.362685 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9019e624-9908-4be0-854a-725dacd09b78 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:21.363308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9019e624-9908-4be0-854a-725dacd09b78 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:21.483107 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9019e624-9908-4be0-854a-725dacd09b78 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:21.505828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9019e624-9908-4be0-854a-725dacd09b78 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1215 microversion: 2.1 time: 0.159905 Aug 01 14:10:21.519186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 135/264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:21 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:22.367614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-96a8778e-1638-4101-a51f-97badcd63a9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:22.369050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-96a8778e-1638-4101-a51f-97badcd63a9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:22.384915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96a8778e-1638-4101-a51f-97badcd63a9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:22.385374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96a8778e-1638-4101-a51f-97badcd63a9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:22.386168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96a8778e-1638-4101-a51f-97badcd63a9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:22.386609 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96a8778e-1638-4101-a51f-97badcd63a9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:22.530844 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-14ae116c-e3d0-4ab2-8936-fcb64054747c tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:22.540274 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-14ae116c-e3d0-4ab2-8936-fcb64054747c tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:22.550032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14ae116c-e3d0-4ab2-8936-fcb64054747c tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:22.554542 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14ae116c-e3d0-4ab2-8936-fcb64054747c tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:22.556875 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14ae116c-e3d0-4ab2-8936-fcb64054747c tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:22.558590 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14ae116c-e3d0-4ab2-8936-fcb64054747c tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:22.622457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-96a8778e-1638-4101-a51f-97badcd63a9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:22.633698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-96a8778e-1638-4101-a51f-97badcd63a9f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.271067 Aug 01 14:10:22.636425 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 130/265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:22 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:22.789944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-14ae116c-e3d0-4ab2-8936-fcb64054747c tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:22.797875 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-14ae116c-e3d0-4ab2-8936-fcb64054747c tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1267 microversion: 2.1 time: 0.272462 Aug 01 14:10:22.798472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 136/266] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:22 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1267 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:23.657244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-11c86a93-4c1f-4454-a86b-03e8b55a35ad tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:23.657939 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-11c86a93-4c1f-4454-a86b-03e8b55a35ad tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:23.666104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11c86a93-4c1f-4454-a86b-03e8b55a35ad tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:23.666557 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11c86a93-4c1f-4454-a86b-03e8b55a35ad tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:23.667339 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11c86a93-4c1f-4454-a86b-03e8b55a35ad tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:23.667769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11c86a93-4c1f-4454-a86b-03e8b55a35ad tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:23.823309 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f0fb9eed-5556-43ab-9d12-bd20ea2b2352 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:23.823927 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f0fb9eed-5556-43ab-9d12-bd20ea2b2352 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:23.830651 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0fb9eed-5556-43ab-9d12-bd20ea2b2352 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:23.831103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0fb9eed-5556-43ab-9d12-bd20ea2b2352 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:23.831874 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0fb9eed-5556-43ab-9d12-bd20ea2b2352 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:23.832377 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0fb9eed-5556-43ab-9d12-bd20ea2b2352 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:23.871710 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-11c86a93-4c1f-4454-a86b-03e8b55a35ad tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:23.880660 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-11c86a93-4c1f-4454-a86b-03e8b55a35ad tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.227376 Aug 01 14:10:23.881436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 131/267] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:23 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:23.903692 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f0fb9eed-5556-43ab-9d12-bd20ea2b2352 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:23.911468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f0fb9eed-5556-43ab-9d12-bd20ea2b2352 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1267 microversion: 2.1 time: 0.092047 Aug 01 14:10:23.912100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 137/268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:23 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:24.904900 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6b72504f-5c8e-41f6-8ee4-89a71c153c86 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:24.906692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6b72504f-5c8e-41f6-8ee4-89a71c153c86 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:24.931638 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-eb6f09b6-665f-4a9f-983c-a4708e525546 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:24.932849 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-eb6f09b6-665f-4a9f-983c-a4708e525546 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:24.935493 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:24.946818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb6f09b6-665f-4a9f-983c-a4708e525546 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:24.947287 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb6f09b6-665f-4a9f-983c-a4708e525546 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:24.948785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b72504f-5c8e-41f6-8ee4-89a71c153c86 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:24.953081 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b72504f-5c8e-41f6-8ee4-89a71c153c86 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:24.957018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b72504f-5c8e-41f6-8ee4-89a71c153c86 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:24.957975 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6b72504f-5c8e-41f6-8ee4-89a71c153c86 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:24.960313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb6f09b6-665f-4a9f-983c-a4708e525546 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:24.960965 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb6f09b6-665f-4a9f-983c-a4708e525546 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:25.059009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-eb6f09b6-665f-4a9f-983c-a4708e525546 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:25.070924 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-eb6f09b6-665f-4a9f-983c-a4708e525546 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1275 microversion: 2.1 time: 0.143039 Aug 01 14:10:25.075058 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 138/269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:24 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1275 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:25.370902 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6b72504f-5c8e-41f6-8ee4-89a71c153c86 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:25.382867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6b72504f-5c8e-41f6-8ee4-89a71c153c86 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.485047 Aug 01 14:10:25.384143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 132/270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:24 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:26.023898 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bbdc534c-ad8e-442f-b069-da96062db9c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:26.025224 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bbdc534c-ad8e-442f-b069-da96062db9c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:26.032199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbdc534c-ad8e-442f-b069-da96062db9c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.032791 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbdc534c-ad8e-442f-b069-da96062db9c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.033809 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbdc534c-ad8e-442f-b069-da96062db9c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.034338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbdc534c-ad8e-442f-b069-da96062db9c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.063504 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bbdc534c-ad8e-442f-b069-da96062db9c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:10:26.094762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8cb179f-df6e-4ad5-abc8-09e33284d5ea tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:26.095417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d8cb179f-df6e-4ad5-abc8-09e33284d5ea tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:26.107366 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8cb179f-df6e-4ad5-abc8-09e33284d5ea tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.108014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8cb179f-df6e-4ad5-abc8-09e33284d5ea tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.108969 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8cb179f-df6e-4ad5-abc8-09e33284d5ea tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.109544 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8cb179f-df6e-4ad5-abc8-09e33284d5ea tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.209723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bbdc534c-ad8e-442f-b069-da96062db9c9 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 204 len: 0 microversion: 2.1 time: 0.189779 Aug 01 14:10:26.210598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 139/271] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:10:26 2022] DELETE /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:10:26.223707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6c30be64-a050-43f4-b4c6-9c9fb16ff2e3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:26.224836 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6c30be64-a050-43f4-b4c6-9c9fb16ff2e3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:26.235014 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c30be64-a050-43f4-b4c6-9c9fb16ff2e3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.235490 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c30be64-a050-43f4-b4c6-9c9fb16ff2e3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.236454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c30be64-a050-43f4-b4c6-9c9fb16ff2e3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.237038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c30be64-a050-43f4-b4c6-9c9fb16ff2e3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.655725 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d8cb179f-df6e-4ad5-abc8-09e33284d5ea tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:26.668625 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d8cb179f-df6e-4ad5-abc8-09e33284d5ea tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1273 microversion: 2.1 time: 0.577186 Aug 01 14:10:26.670906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 133/272] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:26 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1273 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:26.678748 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d07e8cf5-0d03-46bb-8619-577082ae6c56 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:26.679993 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d07e8cf5-0d03-46bb-8619-577082ae6c56 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:26.686918 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d07e8cf5-0d03-46bb-8619-577082ae6c56 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.687671 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d07e8cf5-0d03-46bb-8619-577082ae6c56 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.689329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d07e8cf5-0d03-46bb-8619-577082ae6c56 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:26.689987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d07e8cf5-0d03-46bb-8619-577082ae6c56 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:26.868787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d07e8cf5-0d03-46bb-8619-577082ae6c56 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:26.880380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d07e8cf5-0d03-46bb-8619-577082ae6c56 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.208019 Aug 01 14:10:26.881525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 134/273] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:26 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:27.024457 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6c30be64-a050-43f4-b4c6-9c9fb16ff2e3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:27.042630 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6c30be64-a050-43f4-b4c6-9c9fb16ff2e3 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1555 microversion: 2.1 time: 0.827451 Aug 01 14:10:27.044710 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 140/274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:26 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1555 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:27.696014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aae537c4-8b76-4584-9474-25c81fd29de3 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:27.697299 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aae537c4-8b76-4584-9474-25c81fd29de3 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:27.708976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aae537c4-8b76-4584-9474-25c81fd29de3 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:27.711137 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aae537c4-8b76-4584-9474-25c81fd29de3 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:27.713195 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aae537c4-8b76-4584-9474-25c81fd29de3 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:27.713811 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aae537c4-8b76-4584-9474-25c81fd29de3 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:27.905635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-46e45c27-06c7-4e68-a073-b0de4ba291e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:27.907203 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-46e45c27-06c7-4e68-a073-b0de4ba291e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:27.919291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-46e45c27-06c7-4e68-a073-b0de4ba291e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:27.922425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-46e45c27-06c7-4e68-a073-b0de4ba291e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:27.923459 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-46e45c27-06c7-4e68-a073-b0de4ba291e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:27.925451 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-46e45c27-06c7-4e68-a073-b0de4ba291e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:28.028616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aae537c4-8b76-4584-9474-25c81fd29de3 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:28.041622 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aae537c4-8b76-4584-9474-25c81fd29de3 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.354047 Aug 01 14:10:28.061820 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 135/275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:27 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:28.080418 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-516a35d0-4463-4b41-a9e1-440a744b6863 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:28.081885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-516a35d0-4463-4b41-a9e1-440a744b6863 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:28.103163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-516a35d0-4463-4b41-a9e1-440a744b6863 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:28.104028 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-516a35d0-4463-4b41-a9e1-440a744b6863 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:28.105738 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-516a35d0-4463-4b41-a9e1-440a744b6863 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:28.106516 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-516a35d0-4463-4b41-a9e1-440a744b6863 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:28.418919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-516a35d0-4463-4b41-a9e1-440a744b6863 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:28.434519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-516a35d0-4463-4b41-a9e1-440a744b6863 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1555 microversion: 2.1 time: 0.371124 Aug 01 14:10:28.436854 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 136/276] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:28 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1555 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:28.701745 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-46e45c27-06c7-4e68-a073-b0de4ba291e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:28.711596 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-46e45c27-06c7-4e68-a073-b0de4ba291e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.812271 Aug 01 14:10:28.717297 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 141/277] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:27 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:29.070049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c50b5b0e-99c5-4625-9ae4-15c7624c5997 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:29.070743 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c50b5b0e-99c5-4625-9ae4-15c7624c5997 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:29.098771 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50b5b0e-99c5-4625-9ae4-15c7624c5997 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.099237 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50b5b0e-99c5-4625-9ae4-15c7624c5997 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.100017 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50b5b0e-99c5-4625-9ae4-15c7624c5997 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.100446 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50b5b0e-99c5-4625-9ae4-15c7624c5997 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.440288 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c50b5b0e-99c5-4625-9ae4-15c7624c5997 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:29.455483 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c50b5b0e-99c5-4625-9ae4-15c7624c5997 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.395352 Aug 01 14:10:29.456070 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 137/278] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:29 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:29.462978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bb4a08a9-f3b0-407f-89d3-8de66a7f3d29 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:29.463606 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bb4a08a9-f3b0-407f-89d3-8de66a7f3d29 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:29.471148 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bb4a08a9-f3b0-407f-89d3-8de66a7f3d29 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.471848 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bb4a08a9-f3b0-407f-89d3-8de66a7f3d29 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.473134 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bb4a08a9-f3b0-407f-89d3-8de66a7f3d29 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.474639 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bb4a08a9-f3b0-407f-89d3-8de66a7f3d29 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.744077 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d1598362-bf5b-4239-90f8-c198b49ea155 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:29.745171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d1598362-bf5b-4239-90f8-c198b49ea155 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:29.752746 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1598362-bf5b-4239-90f8-c198b49ea155 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.753398 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1598362-bf5b-4239-90f8-c198b49ea155 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.754864 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1598362-bf5b-4239-90f8-c198b49ea155 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.755491 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1598362-bf5b-4239-90f8-c198b49ea155 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:29.865217 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bb4a08a9-f3b0-407f-89d3-8de66a7f3d29 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:29.874091 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bb4a08a9-f3b0-407f-89d3-8de66a7f3d29 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1555 microversion: 2.1 time: 0.415805 Aug 01 14:10:29.877520 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 142/279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:29 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1555 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:29.967454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-1b149286-26a8-4c60-a719-e57c42e9513f req-ee81ee9d-4f82-43a8-a6d6-ae7f178c8c21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c9e09ab-a6c0-4bc0-860f-e89193795418", "tag": "400818eb-3001-4c0d-a8fe-baa85c801488"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:29.993373 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-1b149286-26a8-4c60-a719-e57c42e9513f req-ee81ee9d-4f82-43a8-a6d6-ae7f178c8c21 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:29.994050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-1b149286-26a8-4c60-a719-e57c42e9513f req-ee81ee9d-4f82-43a8-a6d6-ae7f178c8c21 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.023992 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-1b149286-26a8-4c60-a719-e57c42e9513f req-ee81ee9d-4f82-43a8-a6d6-ae7f178c8c21 service nova] Creating event network-changed:400818eb-3001-4c0d-a8fe-baa85c801488 for instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 on hv-cinder-84713 Aug 01 14:10:30.030579 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-1b149286-26a8-4c60-a719-e57c42e9513f req-ee81ee9d-4f82-43a8-a6d6-ae7f178c8c21 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068442 Aug 01 14:10:30.031472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 143/280] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:10:30.115977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d1598362-bf5b-4239-90f8-c198b49ea155 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:30.140726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d1598362-bf5b-4239-90f8-c198b49ea155 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.400627 Aug 01 14:10:30.149502 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-c3d0407e-aa67-4043-8d9e-e6e5b04df333 req-c621d573-6967-444c-abd1-9133fb4c85f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "553535d2-88d8-4b52-910e-9e103d370fa3", "name": "network-vif-deleted", "tag": "65e39196-7685-44bb-83da-d3a148812c3f"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:30.166099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 138/281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:29 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:30.338506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-c3d0407e-aa67-4043-8d9e-e6e5b04df333 req-c621d573-6967-444c-abd1-9133fb4c85f2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.338506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-c3d0407e-aa67-4043-8d9e-e6e5b04df333 req-c621d573-6967-444c-abd1-9133fb4c85f2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.338506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-c3d0407e-aa67-4043-8d9e-e6e5b04df333 req-c621d573-6967-444c-abd1-9133fb4c85f2 service nova] Creating event network-vif-deleted:65e39196-7685-44bb-83da-d3a148812c3f for instance 553535d2-88d8-4b52-910e-9e103d370fa3 on hv-cinder-84713 Aug 01 14:10:30.338506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-c3d0407e-aa67-4043-8d9e-e6e5b04df333 req-c621d573-6967-444c-abd1-9133fb4c85f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058040 Aug 01 14:10:30.338506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 144/282] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:30.479008 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e8da0cf0-033b-4b9a-bee2-3daae5542682 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:30.479622 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e8da0cf0-033b-4b9a-bee2-3daae5542682 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:30.491659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e8da0cf0-033b-4b9a-bee2-3daae5542682 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.492139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e8da0cf0-033b-4b9a-bee2-3daae5542682 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.492952 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e8da0cf0-033b-4b9a-bee2-3daae5542682 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.494101 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e8da0cf0-033b-4b9a-bee2-3daae5542682 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.755925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e8da0cf0-033b-4b9a-bee2-3daae5542682 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:30.764208 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e8da0cf0-033b-4b9a-bee2-3daae5542682 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.289131 Aug 01 14:10:30.765378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 139/283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:30 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:30.900284 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8c3ec9e8-89a6-4919-952b-ba20e3ecc9e4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:30.901038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8c3ec9e8-89a6-4919-952b-ba20e3ecc9e4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:30.914182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8c3ec9e8-89a6-4919-952b-ba20e3ecc9e4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.915030 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8c3ec9e8-89a6-4919-952b-ba20e3ecc9e4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:30.915988 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8c3ec9e8-89a6-4919-952b-ba20e3ecc9e4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:30.916597 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8c3ec9e8-89a6-4919-952b-ba20e3ecc9e4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:31.059635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8c3ec9e8-89a6-4919-952b-ba20e3ecc9e4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:31.067863 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.071992 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8c3ec9e8-89a6-4919-952b-ba20e3ecc9e4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1346 microversion: 2.1 time: 0.176044 Aug 01 14:10:31.085895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 145/284] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:30 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1346 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:31.181996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8b4cc423-9663-441d-b8be-764fbec76015 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:31.182707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8b4cc423-9663-441d-b8be-764fbec76015 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:31.191783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b4cc423-9663-441d-b8be-764fbec76015 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:31.192769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b4cc423-9663-441d-b8be-764fbec76015 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:31.194054 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b4cc423-9663-441d-b8be-764fbec76015 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:31.194552 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8b4cc423-9663-441d-b8be-764fbec76015 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:31.346410 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8b4cc423-9663-441d-b8be-764fbec76015 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:31.354876 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8b4cc423-9663-441d-b8be-764fbec76015 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.181741 Aug 01 14:10:31.355541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 140/285] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:31 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:31.790471 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-11731257-dc1b-4898-8f42-dadf8058452f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:31.791382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-11731257-dc1b-4898-8f42-dadf8058452f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:31.794397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.795326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=8 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.812207 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11731257-dc1b-4898-8f42-dadf8058452f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:31.819021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11731257-dc1b-4898-8f42-dadf8058452f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:31.820028 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11731257-dc1b-4898-8f42-dadf8058452f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:31.820723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11731257-dc1b-4898-8f42-dadf8058452f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:31.989648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-11731257-dc1b-4898-8f42-dadf8058452f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:31.999343 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-11731257-dc1b-4898-8f42-dadf8058452f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.215355 Aug 01 14:10:32.000534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 146/286] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:31 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:32.101870 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:32.105529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:32.119945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.121245 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.122855 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.125561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.165471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.166174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.166791 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lazy-loading 'fault' on Instance uuid 553535d2-88d8-4b52-910e-9e103d370fa3 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:10:32.215664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:32.226634 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-48804976-10a1-4a6e-9e92-71c59e9ba08d tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1351 microversion: 2.1 time: 0.134958 Aug 01 14:10:32.227792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 141/287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:32 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:32.376738 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8f682f30-46a2-4e15-846b-dd6c347b5e88 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:32.378175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8f682f30-46a2-4e15-846b-dd6c347b5e88 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:32.386923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8f682f30-46a2-4e15-846b-dd6c347b5e88 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.387648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8f682f30-46a2-4e15-846b-dd6c347b5e88 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.389175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8f682f30-46a2-4e15-846b-dd6c347b5e88 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:32.393009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8f682f30-46a2-4e15-846b-dd6c347b5e88 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:32.602456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8f682f30-46a2-4e15-846b-dd6c347b5e88 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:32.610567 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8f682f30-46a2-4e15-846b-dd6c347b5e88 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.238708 Aug 01 14:10:32.611145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 147/288] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:32 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:33.022546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-83b2d369-28e6-4faf-9b72-336a34213aa7 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:33.023519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-83b2d369-28e6-4faf-9b72-336a34213aa7 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:33.030767 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83b2d369-28e6-4faf-9b72-336a34213aa7 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.031641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83b2d369-28e6-4faf-9b72-336a34213aa7 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.032708 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83b2d369-28e6-4faf-9b72-336a34213aa7 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.033394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83b2d369-28e6-4faf-9b72-336a34213aa7 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.248829 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:33.249611 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:33.263875 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.264507 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.265394 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.265936 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.283333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-83b2d369-28e6-4faf-9b72-336a34213aa7 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:33.297251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-83b2d369-28e6-4faf-9b72-336a34213aa7 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.279132 Aug 01 14:10:33.298389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 142/289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:33 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:33.345178 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.346198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.347016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lazy-loading 'fault' on Instance uuid 553535d2-88d8-4b52-910e-9e103d370fa3 {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:10:33.417619 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '822ea58eeb4e4d29b132964c0e3355db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c68666a08e3142de947cfa44ec5816a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:33.431706 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9dcff0d2-d302-4925-82e8-073730418e39 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 200 len: 1351 microversion: 2.1 time: 0.187022 Aug 01 14:10:33.432561 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 148/290] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:33 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 1351 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:33.633795 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc3e7d91-bdb6-4ec1-a773-2bd4579e1ca6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:33.634766 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fc3e7d91-bdb6-4ec1-a773-2bd4579e1ca6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:33.642607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc3e7d91-bdb6-4ec1-a773-2bd4579e1ca6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.649199 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc3e7d91-bdb6-4ec1-a773-2bd4579e1ca6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.659286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc3e7d91-bdb6-4ec1-a773-2bd4579e1ca6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:33.660403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc3e7d91-bdb6-4ec1-a773-2bd4579e1ca6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:33.926117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fc3e7d91-bdb6-4ec1-a773-2bd4579e1ca6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:33.934519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fc3e7d91-bdb6-4ec1-a773-2bd4579e1ca6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.307205 Aug 01 14:10:33.935183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 143/291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:33 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:34.319124 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e35efa00-f199-4279-a454-52f43f0630d9 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:34.320558 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e35efa00-f199-4279-a454-52f43f0630d9 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:34.338102 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e35efa00-f199-4279-a454-52f43f0630d9 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.338825 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e35efa00-f199-4279-a454-52f43f0630d9 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.339790 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e35efa00-f199-4279-a454-52f43f0630d9 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.340666 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e35efa00-f199-4279-a454-52f43f0630d9 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.453498 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:34.456659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:34.463324 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.463782 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.466038 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.466491 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.507533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] HTTP exception thrown: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Request method failure captured: Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 HTTP/1.1 Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595-emEQdNBjBYidV4lwTk3SzVoZm37tIQsoWjQGUpUNZtN2u_RPjaZdSNO6phY6fOniGQD71biq3xyDtw8JvJJNRBQFyx2M4hyTCQLEe7glyoN_Ec-TaSh3uaGe23ogxBme3Q52eoSMFhYLe00UfaGIhrsH1RD5rogG6bE5LyxF2ec Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: c68666a08e3142de947cfa44ec5816a9 Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:10:34.512311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68666a08e3142de947cfa44ec5816a9"}]}] Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c68666a08e3142de947cfa44ec5816a9 Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-DeleteServersTestJSON-1411411204-project Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 822ea58eeb4e4d29b132964c0e3355db Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-DeleteServersTestJSON-1411411204-project Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.513978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '553535d2-88d8-4b52-910e-9e103d370fa3'} Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:10:34.514803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.516165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.520570 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Returning 404 to user: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:10:34.520570 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c61b1eec-7348-4da9-a98f-4f1cc63b376e tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 404 len: 111 microversion: 2.1 time: 0.064167 Aug 01 14:10:34.520570 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 144/292] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:34 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:10:34.697996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:34.704328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:34.707888 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e35efa00-f199-4279-a454-52f43f0630d9 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:34.714344 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.715374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.716386 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.718052 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.719592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e35efa00-f199-4279-a454-52f43f0630d9 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.404710 Aug 01 14:10:34.723120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 149/293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:34 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:34.752009 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] HTTP exception thrown: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Request method failure captured: Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3/os-volume_attachments HTTP/1.1 Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595-emEQdNBjBYidV4lwTk3SzVoZm37tIQsoWjQGUpUNZtN2u_RPjaZdSNO6phY6fOniGQD71biq3xyDtw8JvJJNRBQFyx2M4hyTCQLEe7glyoN_Ec-TaSh3uaGe23ogxBme3Q52eoSMFhYLe00UfaGIhrsH1RD5rogG6bE5LyxF2ec Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: c68666a08e3142de947cfa44ec5816a9 Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:10:34.754686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68666a08e3142de947cfa44ec5816a9"}]}] Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c68666a08e3142de947cfa44ec5816a9 Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-DeleteServersTestJSON-1411411204-project Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 822ea58eeb4e4d29b132964c0e3355db Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-DeleteServersTestJSON-1411411204-project Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.756143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'server_id': '553535d2-88d8-4b52-910e-9e103d370fa3'} Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:10:34.757163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:34.758205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:34.761617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Returning 404 to user: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:10:34.763311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6f0b0895-ebab-44ea-95b8-0f3abf443c4c tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.070158 Aug 01 14:10:34.764619 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 145/294] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:10:34 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3/os-volume_attachments => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:10:34.956949 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-04b77e5d-d936-4cb0-9214-b86191911706 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:34.958278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-04b77e5d-d936-4cb0-9214-b86191911706 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:34.975420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-04b77e5d-d936-4cb0-9214-b86191911706 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.976361 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-04b77e5d-d936-4cb0-9214-b86191911706 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:34.977973 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-04b77e5d-d936-4cb0-9214-b86191911706 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:34.978783 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-04b77e5d-d936-4cb0-9214-b86191911706 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:35.313440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-04b77e5d-d936-4cb0-9214-b86191911706 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:35.330523 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-04b77e5d-d936-4cb0-9214-b86191911706 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.371998 Aug 01 14:10:35.332556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 150/295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:34 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:35.747139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cf7e8236-1b0e-49ca-abe8-d43772bb8389 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:35.747871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cf7e8236-1b0e-49ca-abe8-d43772bb8389 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:35.754008 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf7e8236-1b0e-49ca-abe8-d43772bb8389 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:35.754464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf7e8236-1b0e-49ca-abe8-d43772bb8389 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:35.755229 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf7e8236-1b0e-49ca-abe8-d43772bb8389 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:35.755663 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf7e8236-1b0e-49ca-abe8-d43772bb8389 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:35.933088 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cf7e8236-1b0e-49ca-abe8-d43772bb8389 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:35.943565 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cf7e8236-1b0e-49ca-abe8-d43772bb8389 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.202731 Aug 01 14:10:35.944405 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 146/296] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:35 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:36.239501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:36.240557 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:36.248664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.248664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.249116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.249683 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.266400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] HTTP exception thrown: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Request method failure captured: Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 HTTP/1.1 Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595-emEQdNBjBYidV4lwTk3SzVoZm37tIQsoWjQGUpUNZtN2u_RPjaZdSNO6phY6fOniGQD71biq3xyDtw8JvJJNRBQFyx2M4hyTCQLEe7glyoN_Ec-TaSh3uaGe23ogxBme3Q52eoSMFhYLe00UfaGIhrsH1RD5rogG6bE5LyxF2ec Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: c68666a08e3142de947cfa44ec5816a9 Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:10:36.271781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68666a08e3142de947cfa44ec5816a9"}]}] Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: c68666a08e3142de947cfa44ec5816a9 Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-DeleteServersTestJSON-1411411204-project Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 822ea58eeb4e4d29b132964c0e3355db Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-DeleteServersTestJSON-1411411204-project Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.273460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '553535d2-88d8-4b52-910e-9e103d370fa3'} Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:10:36.274289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.275635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.278978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Returning 404 to user: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:10:36.279850 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ffa711d6-42b9-416f-970f-e354c607d3c4 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "DELETE /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 404 len: 111 microversion: 2.1 time: 0.044293 Aug 01 14:10:36.283934 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 151/297] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:10:36 2022] DELETE /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:10:36.291010 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:36.292439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] [instance: 553535d2-88d8-4b52-910e-9e103d370fa3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:36.305362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.305966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.306965 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.307527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.328182 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] HTTP exception thrown: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Request method failure captured: Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 HTTP/1.1 Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595-emEQdNBjBYidV4lwTk3SzVoZm37tIQsoWjQGUpUNZtN2u_RPjaZdSNO6phY6fOniGQD71biq3xyDtw8JvJJNRBQFyx2M4hyTCQLEe7glyoN_Ec-TaSh3uaGe23ogxBme3Q52eoSMFhYLe00UfaGIhrsH1RD5rogG6bE5LyxF2ec Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: c68666a08e3142de947cfa44ec5816a9 Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:10:36.330246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c68666a08e3142de947cfa44ec5816a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c68666a08e3142de947cfa44ec5816a9"}]}] Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c68666a08e3142de947cfa44ec5816a9 Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-DeleteServersTestJSON-1411411204 Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-DeleteServersTestJSON-1411411204-project Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 822ea58eeb4e4d29b132964c0e3355db Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-DeleteServersTestJSON-1411411204-project Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.331429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '553535d2-88d8-4b52-910e-9e103d370fa3'} Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:10:36.332076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. Aug 01 14:10:36.333230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:36.334168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] Returning 404 to user: Instance 553535d2-88d8-4b52-910e-9e103d370fa3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:10:36.334168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4a3b5dd1-cb46-48a1-b6b2-0735a1e1e587 tempest-DeleteServersTestJSON-1411411204 tempest-DeleteServersTestJSON-1411411204-project] 10.222.0.48 "GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3" status: 404 len: 111 microversion: 2.1 time: 0.046724 Aug 01 14:10:36.334168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 147/298] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:36 2022] GET /compute/v2.1/servers/553535d2-88d8-4b52-910e-9e103d370fa3 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:10:36.353850 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-41f4bc63-8d3a-4a16-b708-231c1b7c7824 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:36.354462 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-41f4bc63-8d3a-4a16-b708-231c1b7c7824 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:36.369400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-41f4bc63-8d3a-4a16-b708-231c1b7c7824 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.369498 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-41f4bc63-8d3a-4a16-b708-231c1b7c7824 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.370239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-41f4bc63-8d3a-4a16-b708-231c1b7c7824 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.370674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-41f4bc63-8d3a-4a16-b708-231c1b7c7824 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.651083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-41f4bc63-8d3a-4a16-b708-231c1b7c7824 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:36.659163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-41f4bc63-8d3a-4a16-b708-231c1b7c7824 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.309627 Aug 01 14:10:36.663372 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 152/299] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:36 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:36.968887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9a5988c1-2bc4-429b-8bd0-556adc07823b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:36.970360 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9a5988c1-2bc4-429b-8bd0-556adc07823b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:36.980669 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a5988c1-2bc4-429b-8bd0-556adc07823b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.981360 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a5988c1-2bc4-429b-8bd0-556adc07823b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.982284 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a5988c1-2bc4-429b-8bd0-556adc07823b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:36.982826 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a5988c1-2bc4-429b-8bd0-556adc07823b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:36.988516 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:37.161211 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9a5988c1-2bc4-429b-8bd0-556adc07823b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:37.168929 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9a5988c1-2bc4-429b-8bd0-556adc07823b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.207190 Aug 01 14:10:37.169802 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 148/300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:36 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:37.683141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b3d5d098-376b-444a-aa62-a5a5216c5787 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:37.683750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b3d5d098-376b-444a-aa62-a5a5216c5787 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:37.690414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b3d5d098-376b-444a-aa62-a5a5216c5787 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:37.691396 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b3d5d098-376b-444a-aa62-a5a5216c5787 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:37.692170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b3d5d098-376b-444a-aa62-a5a5216c5787 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:37.692636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b3d5d098-376b-444a-aa62-a5a5216c5787 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:37.900241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b3d5d098-376b-444a-aa62-a5a5216c5787 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:37.909249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b3d5d098-376b-444a-aa62-a5a5216c5787 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.229873 Aug 01 14:10:37.910128 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 153/301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:37 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:38.196044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-26fe232d-7d06-4445-91ae-612dab793554 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:38.198333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-26fe232d-7d06-4445-91ae-612dab793554 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:38.213491 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-26fe232d-7d06-4445-91ae-612dab793554 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.214383 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-26fe232d-7d06-4445-91ae-612dab793554 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:38.215703 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-26fe232d-7d06-4445-91ae-612dab793554 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.217612 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-26fe232d-7d06-4445-91ae-612dab793554 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:38.438880 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-26fe232d-7d06-4445-91ae-612dab793554 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:38.448657 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-26fe232d-7d06-4445-91ae-612dab793554 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.261389 Aug 01 14:10:38.450047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 149/302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:38 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:38.848645 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-51bde755-d983-442b-9053-ed778c7e74fc req-0bedbadc-c066-4931-8f7f-b584665402ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9e09ab-a6c0-4bc0-860f-e89193795418", "name": "network-vif-plugged", "status": "completed", "tag": "400818eb-3001-4c0d-a8fe-baa85c801488"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:38.867464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-51bde755-d983-442b-9053-ed778c7e74fc req-0bedbadc-c066-4931-8f7f-b584665402ec service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.867916 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-51bde755-d983-442b-9053-ed778c7e74fc req-0bedbadc-c066-4931-8f7f-b584665402ec service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:38.880022 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-51bde755-d983-442b-9053-ed778c7e74fc req-0bedbadc-c066-4931-8f7f-b584665402ec service nova] Creating event network-vif-plugged:400818eb-3001-4c0d-a8fe-baa85c801488 for instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 on hv-cinder-84713 Aug 01 14:10:38.906577 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-51bde755-d983-442b-9053-ed778c7e74fc req-0bedbadc-c066-4931-8f7f-b584665402ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062021 Aug 01 14:10:38.907204 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 154/303] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:38.937375 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-30e5b71a-1493-4d25-9655-5ed29d094157 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:38.939689 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-30e5b71a-1493-4d25-9655-5ed29d094157 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:38.963154 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30e5b71a-1493-4d25-9655-5ed29d094157 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.965925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30e5b71a-1493-4d25-9655-5ed29d094157 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:38.967692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30e5b71a-1493-4d25-9655-5ed29d094157 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:38.969471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30e5b71a-1493-4d25-9655-5ed29d094157 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:39.246284 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-30e5b71a-1493-4d25-9655-5ed29d094157 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:39.256037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-30e5b71a-1493-4d25-9655-5ed29d094157 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.328803 Aug 01 14:10:39.256701 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 150/304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:38 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:39.477061 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-68d70855-231e-492f-8ff0-08b4c703a3a2 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:39.478325 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-68d70855-231e-492f-8ff0-08b4c703a3a2 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:39.486642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-68d70855-231e-492f-8ff0-08b4c703a3a2 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:39.488083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-68d70855-231e-492f-8ff0-08b4c703a3a2 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:39.489285 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-68d70855-231e-492f-8ff0-08b4c703a3a2 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:39.489956 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-68d70855-231e-492f-8ff0-08b4c703a3a2 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:39.701539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-68d70855-231e-492f-8ff0-08b4c703a3a2 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:39.705553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-68d70855-231e-492f-8ff0-08b4c703a3a2 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 0.233428 Aug 01 14:10:39.708530 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 155/305] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:39 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:40.280534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1fe0e6f5-6049-4b59-9e12-7f294df33bc9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:40.283185 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1fe0e6f5-6049-4b59-9e12-7f294df33bc9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:40.306785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1fe0e6f5-6049-4b59-9e12-7f294df33bc9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:40.310464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1fe0e6f5-6049-4b59-9e12-7f294df33bc9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:40.316125 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1fe0e6f5-6049-4b59-9e12-7f294df33bc9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:40.317076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1fe0e6f5-6049-4b59-9e12-7f294df33bc9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:40.606275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1fe0e6f5-6049-4b59-9e12-7f294df33bc9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:40.616354 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1fe0e6f5-6049-4b59-9e12-7f294df33bc9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.340054 Aug 01 14:10:40.616986 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 151/306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:40 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:40.726701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-db4fbf4b-f6c6-4099-955a-dc9a1650cc76 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:40.728186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-db4fbf4b-f6c6-4099-955a-dc9a1650cc76 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:40.742564 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-db4fbf4b-f6c6-4099-955a-dc9a1650cc76 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:40.743021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-db4fbf4b-f6c6-4099-955a-dc9a1650cc76 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:40.743800 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-db4fbf4b-f6c6-4099-955a-dc9a1650cc76 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:40.744239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-db4fbf4b-f6c6-4099-955a-dc9a1650cc76 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:41.642582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0271c145-2636-462b-8796-4e057b44fbf6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:41.644854 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0271c145-2636-462b-8796-4e057b44fbf6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:41.651589 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0271c145-2636-462b-8796-4e057b44fbf6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:41.652042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0271c145-2636-462b-8796-4e057b44fbf6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:41.652920 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0271c145-2636-462b-8796-4e057b44fbf6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:41.653531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0271c145-2636-462b-8796-4e057b44fbf6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:41.744828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-db4fbf4b-f6c6-4099-955a-dc9a1650cc76 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:41.770975 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-db4fbf4b-f6c6-4099-955a-dc9a1650cc76 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1315 microversion: 2.1 time: 1.044392 Aug 01 14:10:41.804041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 156/307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:40 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1315 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:41.916337 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0271c145-2636-462b-8796-4e057b44fbf6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:41.924614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0271c145-2636-462b-8796-4e057b44fbf6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.285768 Aug 01 14:10:41.926193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 152/308] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:41 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:42.796514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e8d0b60b-d074-4a46-9826-910058a1b29b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:42.797969 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e8d0b60b-d074-4a46-9826-910058a1b29b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:42.807869 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e8d0b60b-d074-4a46-9826-910058a1b29b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.810857 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e8d0b60b-d074-4a46-9826-910058a1b29b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.821406 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e8d0b60b-d074-4a46-9826-910058a1b29b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.822281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e8d0b60b-d074-4a46-9826-910058a1b29b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.949625 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-402a9538-8bec-4e54-babf-d815f5d3177a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:42.950833 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-402a9538-8bec-4e54-babf-d815f5d3177a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:42.976244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-402a9538-8bec-4e54-babf-d815f5d3177a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.976979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-402a9538-8bec-4e54-babf-d815f5d3177a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.978023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-402a9538-8bec-4e54-babf-d815f5d3177a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:42.978618 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-402a9538-8bec-4e54-babf-d815f5d3177a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:42.998331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e8d0b60b-d074-4a46-9826-910058a1b29b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:43.010306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e8d0b60b-d074-4a46-9826-910058a1b29b tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1464 microversion: 2.1 time: 0.217532 Aug 01 14:10:43.024867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 157/309] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:42 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1464 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:43.100380 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-62b44996-229f-4cf8-8f50-48bc54499f5f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:43.101025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-62b44996-229f-4cf8-8f50-48bc54499f5f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:43.107516 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-62b44996-229f-4cf8-8f50-48bc54499f5f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:43.108243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-62b44996-229f-4cf8-8f50-48bc54499f5f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:43.109331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-62b44996-229f-4cf8-8f50-48bc54499f5f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:43.109868 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-62b44996-229f-4cf8-8f50-48bc54499f5f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:43.160935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-62b44996-229f-4cf8-8f50-48bc54499f5f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:10:43.212505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-402a9538-8bec-4e54-babf-d815f5d3177a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:43.226771 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-402a9538-8bec-4e54-babf-d815f5d3177a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.281680 Aug 01 14:10:43.228527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 153/310] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:42 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:43.290742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-62b44996-229f-4cf8-8f50-48bc54499f5f tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 204 len: 0 microversion: 2.1 time: 0.194637 Aug 01 14:10:43.291759 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 158/311] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:10:43 2022] DELETE /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:10:43.304643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d43855d2-91bf-4e89-9608-358cb4e92b1d tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:43.306755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d43855d2-91bf-4e89-9608-358cb4e92b1d tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:43.315891 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d43855d2-91bf-4e89-9608-358cb4e92b1d tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:43.316464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d43855d2-91bf-4e89-9608-358cb4e92b1d tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:43.317880 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d43855d2-91bf-4e89-9608-358cb4e92b1d tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:43.318475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d43855d2-91bf-4e89-9608-358cb4e92b1d tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:43.536227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d43855d2-91bf-4e89-9608-358cb4e92b1d tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:43.544803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d43855d2-91bf-4e89-9608-358cb4e92b1d tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1470 microversion: 2.1 time: 0.245335 Aug 01 14:10:43.560334 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 154/312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:43 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1470 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:44.249743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-88f480bc-3f07-4aef-8c63-ffeab763412a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:44.251365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-88f480bc-3f07-4aef-8c63-ffeab763412a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:44.257947 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-88f480bc-3f07-4aef-8c63-ffeab763412a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:44.258400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-88f480bc-3f07-4aef-8c63-ffeab763412a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:44.259204 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-88f480bc-3f07-4aef-8c63-ffeab763412a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:44.259673 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-88f480bc-3f07-4aef-8c63-ffeab763412a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:44.466388 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-88f480bc-3f07-4aef-8c63-ffeab763412a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:44.478555 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-88f480bc-3f07-4aef-8c63-ffeab763412a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.231658 Aug 01 14:10:44.479163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 159/313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:44 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:44.568380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-988d845d-3d7c-4067-9ec8-c5be7f4bb018 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:44.569145 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-988d845d-3d7c-4067-9ec8-c5be7f4bb018 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:44.575138 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-988d845d-3d7c-4067-9ec8-c5be7f4bb018 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:44.575821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-988d845d-3d7c-4067-9ec8-c5be7f4bb018 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:44.576790 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-988d845d-3d7c-4067-9ec8-c5be7f4bb018 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:44.577374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-988d845d-3d7c-4067-9ec8-c5be7f4bb018 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:44.627040 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-33e8f45c-2151-489a-a54b-70bc015e10ac tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Action: 'create', calling method: .version_select at 0x7f44681e4430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-982853475", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElFD6p2/lXnsbEgLDZR1M7RKO4X1gMTzbMvHLgxXELsnwWrSAfiBnyoPjXVPJqA8rSI+0foko0cPaWLnn9ftYTFK1VuoIkor67z4XiuqYnby4FgeoGYjalxmrun8r4DqA=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:44.653464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-33e8f45c-2151-489a-a54b-70bc015e10ac tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Getting quotas for project a8630c7be7ea49d5b6d3ef6d46fd653e. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:44.659709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-33e8f45c-2151-489a-a54b-70bc015e10ac tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Getting quotas for user b6ed2d0b015d4fe39d780306d04fba4d and project a8630c7be7ea49d5b6d3ef6d46fd653e. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:44.704234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-33e8f45c-2151-489a-a54b-70bc015e10ac tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.082497 Aug 01 14:10:44.705205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 160/314] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:10:44 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:10:44.787181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-988d845d-3d7c-4067-9ec8-c5be7f4bb018 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:44.797355 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-988d845d-3d7c-4067-9ec8-c5be7f4bb018 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1470 microversion: 2.1 time: 0.232331 Aug 01 14:10:44.805221 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 155/315] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:44 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1470 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:44.856614 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-49785264", "imageRef": "db5ee82b-f272-419a-9190-6acd20c8361d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-982853475", "networks": [{"uuid": "4472773e-7601-4149-8e58-b66a3eea2d3b"}]}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:44.910440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] validate_networks() for [('4472773e-7601-4149-8e58-b66a3eea2d3b', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:10:45.499795 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-02ec26ca-b10e-43c6-8126-ae80a4725119 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:45.500355 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-02ec26ca-b10e-43c6-8126-ae80a4725119 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:45.507780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02ec26ca-b10e-43c6-8126-ae80a4725119 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.508298 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02ec26ca-b10e-43c6-8126-ae80a4725119 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.509124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02ec26ca-b10e-43c6-8126-ae80a4725119 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.509780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02ec26ca-b10e-43c6-8126-ae80a4725119 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.650209 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02ec26ca-b10e-43c6-8126-ae80a4725119 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:45.658859 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-02ec26ca-b10e-43c6-8126-ae80a4725119 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.163323 Aug 01 14:10:45.659675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 156/316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:45 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:45.691160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:10:45.691160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:10:45.691741 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:10:45.691830 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:10:45.692227 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:10:45.703903 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.704596 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.705525 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.706089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.724399 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Getting quotas for project a8630c7be7ea49d5b6d3ef6d46fd653e. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:45.728965 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Getting quotas for user b6ed2d0b015d4fe39d780306d04fba4d and project a8630c7be7ea49d5b6d3ef6d46fd653e. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:45.742028 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:10:45.744257 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db5ee82b-f272-419a-9190-6acd20c8361d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:10:45.801451 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bbdb2eac-c982-4cc8-b96d-27d14d6ef7eb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949021 Aug 01 14:10:45.802123 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 161/317] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:10:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:10:45.814941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c4e560b0-9876-46f4-9395-e36df7434218 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:45.816107 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c4e560b0-9876-46f4-9395-e36df7434218 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:45.826603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d405c038-81ba-4f3e-9aa1-f8bb923f4df5 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:45.828042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d405c038-81ba-4f3e-9aa1-f8bb923f4df5 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:45.834808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d405c038-81ba-4f3e-9aa1-f8bb923f4df5 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.835363 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d405c038-81ba-4f3e-9aa1-f8bb923f4df5 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.836234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d405c038-81ba-4f3e-9aa1-f8bb923f4df5 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:45.836802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d405c038-81ba-4f3e-9aa1-f8bb923f4df5 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:45.896327 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c4e560b0-9876-46f4-9395-e36df7434218 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:45.904285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c4e560b0-9876-46f4-9395-e36df7434218 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1256 microversion: 2.1 time: 0.094702 Aug 01 14:10:45.920539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 157/318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:45 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1256 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:46.105472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d405c038-81ba-4f3e-9aa1-f8bb923f4df5 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:46.114367 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d405c038-81ba-4f3e-9aa1-f8bb923f4df5 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1470 microversion: 2.1 time: 0.291769 Aug 01 14:10:46.133069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 162/319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:45 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1470 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:46.679212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-061b0892-1f62-4af2-9df2-2ddbc85af635 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:46.679846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-061b0892-1f62-4af2-9df2-2ddbc85af635 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:46.695368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-061b0892-1f62-4af2-9df2-2ddbc85af635 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:46.695942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-061b0892-1f62-4af2-9df2-2ddbc85af635 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.696920 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-061b0892-1f62-4af2-9df2-2ddbc85af635 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:46.697628 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-061b0892-1f62-4af2-9df2-2ddbc85af635 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.927984 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dcf88d41-4882-4464-8966-4bbda38cd7bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:46.929269 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dcf88d41-4882-4464-8966-4bbda38cd7bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:46.935959 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dcf88d41-4882-4464-8966-4bbda38cd7bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:46.936424 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dcf88d41-4882-4464-8966-4bbda38cd7bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.937234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dcf88d41-4882-4464-8966-4bbda38cd7bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:46.937828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dcf88d41-4882-4464-8966-4bbda38cd7bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:46.958644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:47.014955 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dcf88d41-4882-4464-8966-4bbda38cd7bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:47.023728 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dcf88d41-4882-4464-8966-4bbda38cd7bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1260 microversion: 2.1 time: 0.100572 Aug 01 14:10:47.024582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 163/320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:46 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1260 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:47.124235 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-061b0892-1f62-4af2-9df2-2ddbc85af635 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:47.135214 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e140738b-1b78-4063-aee1-2593bc807ddf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:47.135881 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e140738b-1b78-4063-aee1-2593bc807ddf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:47.139155 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-061b0892-1f62-4af2-9df2-2ddbc85af635 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.462016 Aug 01 14:10:47.140016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 158/321] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:46 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:47.146275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e140738b-1b78-4063-aee1-2593bc807ddf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:47.147058 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e140738b-1b78-4063-aee1-2593bc807ddf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:47.148601 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e140738b-1b78-4063-aee1-2593bc807ddf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:47.149714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e140738b-1b78-4063-aee1-2593bc807ddf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:47.447701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e140738b-1b78-4063-aee1-2593bc807ddf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:47.456806 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e140738b-1b78-4063-aee1-2593bc807ddf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1470 microversion: 2.1 time: 0.325316 Aug 01 14:10:47.473201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 164/322] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:47 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1470 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:47.801884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-254a85d3-e74a-4b33-8917-d86d0593d456 req-adc4523e-90c6-4b56-8f96-bcc2ec3ac0fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c9e09ab-a6c0-4bc0-860f-e89193795418", "name": "network-vif-deleted", "tag": "400818eb-3001-4c0d-a8fe-baa85c801488"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:47.814414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-254a85d3-e74a-4b33-8917-d86d0593d456 req-adc4523e-90c6-4b56-8f96-bcc2ec3ac0fa service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:47.814880 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-254a85d3-e74a-4b33-8917-d86d0593d456 req-adc4523e-90c6-4b56-8f96-bcc2ec3ac0fa service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:47.833038 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-254a85d3-e74a-4b33-8917-d86d0593d456 req-adc4523e-90c6-4b56-8f96-bcc2ec3ac0fa service nova] Creating event network-vif-deleted:400818eb-3001-4c0d-a8fe-baa85c801488 for instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 on hv-cinder-84713 Aug 01 14:10:47.842678 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-254a85d3-e74a-4b33-8917-d86d0593d456 req-adc4523e-90c6-4b56-8f96-bcc2ec3ac0fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044731 Aug 01 14:10:47.843292 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 159/323] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:48.045578 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f4316542-9b04-446e-a844-3601071fa1e0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:48.046381 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f4316542-9b04-446e-a844-3601071fa1e0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:48.053725 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f4316542-9b04-446e-a844-3601071fa1e0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.054782 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f4316542-9b04-446e-a844-3601071fa1e0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.055658 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f4316542-9b04-446e-a844-3601071fa1e0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.056255 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f4316542-9b04-446e-a844-3601071fa1e0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.130380 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f4316542-9b04-446e-a844-3601071fa1e0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:48.144906 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f4316542-9b04-446e-a844-3601071fa1e0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1308 microversion: 2.1 time: 0.103303 Aug 01 14:10:48.159796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 165/324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:48 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1308 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:48.162210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c9f16829-69ae-4acf-8b17-3921b534bc04 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:48.163468 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c9f16829-69ae-4acf-8b17-3921b534bc04 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:48.173304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9f16829-69ae-4acf-8b17-3921b534bc04 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.174582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9f16829-69ae-4acf-8b17-3921b534bc04 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.175598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9f16829-69ae-4acf-8b17-3921b534bc04 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.176304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9f16829-69ae-4acf-8b17-3921b534bc04 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.461607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c9f16829-69ae-4acf-8b17-3921b534bc04 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:48.474966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c9f16829-69ae-4acf-8b17-3921b534bc04 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1522 microversion: 2.1 time: 0.316922 Aug 01 14:10:48.475885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 160/325] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:48 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:48.480614 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e804ecd2-29c8-4941-b0d0-02488aa25edf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:48.481237 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e804ecd2-29c8-4941-b0d0-02488aa25edf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:48.490364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e804ecd2-29c8-4941-b0d0-02488aa25edf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.491432 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e804ecd2-29c8-4941-b0d0-02488aa25edf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.491649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e804ecd2-29c8-4941-b0d0-02488aa25edf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:48.492090 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e804ecd2-29c8-4941-b0d0-02488aa25edf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:48.610112 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e804ecd2-29c8-4941-b0d0-02488aa25edf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:48.618458 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e804ecd2-29c8-4941-b0d0-02488aa25edf tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1300 microversion: 2.1 time: 0.142014 Aug 01 14:10:48.619125 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 166/326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:48 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1300 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:49.167140 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-56830e1d-78b7-4bda-940a-21a699988cce tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:49.167838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-56830e1d-78b7-4bda-940a-21a699988cce tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:49.174554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56830e1d-78b7-4bda-940a-21a699988cce tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.175081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56830e1d-78b7-4bda-940a-21a699988cce tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.175931 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56830e1d-78b7-4bda-940a-21a699988cce tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.176455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56830e1d-78b7-4bda-940a-21a699988cce tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.238576 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-07d5906e-0472-47a9-be64-9fd5455e9a32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'create', calling method: .version_select at 0x7f4468213280>, body: {"keypair": {"name": "tempest-keypair-1834863452", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHSNdxsRLFn1yRSQBc80af/T1YEiHiv7HwH2MPKaC6VjuvDWbX61PnDVsooAAgeOB8/cJTjW8tWlUKF68MmvaWJ+uvkntwoDudUbgoNwJCV0RFwfMXQjaKKCqx5odLzjg=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:49.242960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-56830e1d-78b7-4bda-940a-21a699988cce tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:49.250785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-56830e1d-78b7-4bda-940a-21a699988cce tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1314 microversion: 2.1 time: 0.087466 Aug 01 14:10:49.251362 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 167/327] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:49 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1314 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:49.265715 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-07d5906e-0472-47a9-be64-9fd5455e9a32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Getting quotas for project c3d2b7b0783c4cc7bd0ce59a13f70efa. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:49.270282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-07d5906e-0472-47a9-be64-9fd5455e9a32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Getting quotas for user ebe4b3455a3d4139a1267da97bd83662 and project c3d2b7b0783c4cc7bd0ce59a13f70efa. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:49.307457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-07d5906e-0472-47a9-be64-9fd5455e9a32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.194120 Aug 01 14:10:49.308056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 161/328] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:10:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:10:49.495309 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-789d1ae3-9a3d-4e2b-89eb-28cffc4be6e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:49.496686 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-789d1ae3-9a3d-4e2b-89eb-28cffc4be6e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:49.498950 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:49.507069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-789d1ae3-9a3d-4e2b-89eb-28cffc4be6e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.510461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-789d1ae3-9a3d-4e2b-89eb-28cffc4be6e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.513578 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-789d1ae3-9a3d-4e2b-89eb-28cffc4be6e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.514220 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-789d1ae3-9a3d-4e2b-89eb-28cffc4be6e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.639327 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:49.639948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:49.647053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.647505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.648289 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.648937 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.682196 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:49.682647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:49.683102 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lazy-loading 'fault' on Instance uuid 0c9e09ab-a6c0-4bc0-860f-e89193795418 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:10:49.750295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f415b2218694e828b0d160dfce5e114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd0cc00c61d3e4e59b5790c99c6277d2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:49.759461 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a191f1f9-a939-4f59-b44d-73d1a5b9a7e8 tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 200 len: 1305 microversion: 2.1 time: 0.123951 Aug 01 14:10:49.761151 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 162/329] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:49 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 1305 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:49.989497 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-789d1ae3-9a3d-4e2b-89eb-28cffc4be6e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:50.001662 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-789d1ae3-9a3d-4e2b-89eb-28cffc4be6e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1502 microversion: 2.1 time: 0.509961 Aug 01 14:10:50.003484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 168/330] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:49 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1502 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:50.025583 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-72757005-3b82-4be4-9060-553afb17e74f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:50.026305 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-72757005-3b82-4be4-9060-553afb17e74f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:50.028648 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:50.036904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72757005-3b82-4be4-9060-553afb17e74f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.037637 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72757005-3b82-4be4-9060-553afb17e74f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.038425 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72757005-3b82-4be4-9060-553afb17e74f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.038862 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72757005-3b82-4be4-9060-553afb17e74f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.274771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-854a1778-b2a7-4fbb-93a8-6a5f5716e2f9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:50.275974 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-854a1778-b2a7-4fbb-93a8-6a5f5716e2f9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:50.280863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72757005-3b82-4be4-9060-553afb17e74f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:50.284495 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-854a1778-b2a7-4fbb-93a8-6a5f5716e2f9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.289615 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-854a1778-b2a7-4fbb-93a8-6a5f5716e2f9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.291059 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-854a1778-b2a7-4fbb-93a8-6a5f5716e2f9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.291434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-72757005-3b82-4be4-9060-553afb17e74f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1516 microversion: 2.1 time: 0.270141 Aug 01 14:10:50.292025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 163/331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:50 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1516 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:50.298588 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-854a1778-b2a7-4fbb-93a8-6a5f5716e2f9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.420834 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-854a1778-b2a7-4fbb-93a8-6a5f5716e2f9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:50.430168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-854a1778-b2a7-4fbb-93a8-6a5f5716e2f9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1314 microversion: 2.1 time: 0.160611 Aug 01 14:10:50.431575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 169/332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:50 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:50.781945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:50.783959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] [instance: 0c9e09ab-a6c0-4bc0-860f-e89193795418] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:50.802835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.805938 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.807970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:50.810237 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:50.847994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] HTTP exception thrown: Instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 could not be found. Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Request method failure captured: Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 HTTP/1.1 Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi597KLGdxwwddtmX8CJJlKeVy0fftcBXr-Ai2o9Mv0VQLcw4JyGfmL30nMI16vttjUN7frgW0Ma8nVrZ_VwO0H3NjAOtKsYQdQn5fP1pLvT4sUkeY-n1JBNGQy0NH_vZh2joDOZqLm9pefZr9d0GY9Ga71KxOtnpBzWZoA_Hwc8vCc_4 Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: d0cc00c61d3e4e59b5790c99c6277d2d Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-76258611 Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:10:50.866414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d0cc00c61d3e4e59b5790c99c6277d2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0cc00c61d3e4e59b5790c99c6277d2d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d0cc00c61d3e4e59b5790c99c6277d2d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d0cc00c61d3e4e59b5790c99c6277d2d"}]}] Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-76258611 Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: d0cc00c61d3e4e59b5790c99c6277d2d Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-76258611 Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-76258611-project Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 7f415b2218694e828b0d160dfce5e114 Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-76258611-project Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 could not be found. Aug 01 14:10:50.867643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '0c9e09ab-a6c0-4bc0-860f-e89193795418'} Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 could not be found. Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:10:50.868453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 could not be found. Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 could not be found. Aug 01 14:10:50.869673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:10:50.879004 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] Returning 404 to user: Instance 0c9e09ab-a6c0-4bc0-860f-e89193795418 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:10:50.881683 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-40b7d643-5a52-4f1c-96fe-b7602eadd3dc tempest-VolumesNegativeTest-76258611 tempest-VolumesNegativeTest-76258611-project] 10.222.0.48 "GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418" status: 404 len: 111 microversion: 2.1 time: 0.103736 Aug 01 14:10:50.888665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 164/333] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:50 2022] GET /compute/v2.1/servers/0c9e09ab-a6c0-4bc0-860f-e89193795418 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:10:51.456792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d90ee1d6-c411-4587-99da-2ab1362fb41f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:51.458123 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d90ee1d6-c411-4587-99da-2ab1362fb41f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:51.468181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d90ee1d6-c411-4587-99da-2ab1362fb41f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:51.475926 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d90ee1d6-c411-4587-99da-2ab1362fb41f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:51.476875 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d90ee1d6-c411-4587-99da-2ab1362fb41f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:51.477494 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d90ee1d6-c411-4587-99da-2ab1362fb41f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:51.504058 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1302045033", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "997ead77-fabf-46da-9c53-333e78171b19"}], "security_groups": [{"name": "tempest-securitygroup--967060295"}], "key_name": "tempest-keypair-1834863452", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:51.812347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d90ee1d6-c411-4587-99da-2ab1362fb41f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:51.838680 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d90ee1d6-c411-4587-99da-2ab1362fb41f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.385226 Aug 01 14:10:51.854982 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 170/334] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:51 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:52.105394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] validate_networks() for [('997ead77-fabf-46da-9c53-333e78171b19', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:10:52.787679 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-2f070507-49a6-4ee5-94b0-7b12f4706389 req-7e725634-5bd1-4e2c-aef8-2abdf71cf65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0b1caa-a17e-4a0f-b54e-9d0be62f316d", "tag": "49a0f089-f785-418c-9210-780bc0f62f14"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:52.840233 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-2f070507-49a6-4ee5-94b0-7b12f4706389 req-7e725634-5bd1-4e2c-aef8-2abdf71cf65d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:52.840883 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-2f070507-49a6-4ee5-94b0-7b12f4706389 req-7e725634-5bd1-4e2c-aef8-2abdf71cf65d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:52.898282 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-2f070507-49a6-4ee5-94b0-7b12f4706389 req-7e725634-5bd1-4e2c-aef8-2abdf71cf65d service nova] Creating event network-changed:49a0f089-f785-418c-9210-780bc0f62f14 for instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d on hv-cinder-84713 Aug 01 14:10:52.914679 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-2f070507-49a6-4ee5-94b0-7b12f4706389 req-7e725634-5bd1-4e2c-aef8-2abdf71cf65d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131086 Aug 01 14:10:52.919220 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 171/335] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:10:52.940670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-78cc0242-4f0d-4ff2-8587-c951d9699766 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:52.945105 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-78cc0242-4f0d-4ff2-8587-c951d9699766 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:52.968953 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78cc0242-4f0d-4ff2-8587-c951d9699766 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:52.969385 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78cc0242-4f0d-4ff2-8587-c951d9699766 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:52.970103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78cc0242-4f0d-4ff2-8587-c951d9699766 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:52.976570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78cc0242-4f0d-4ff2-8587-c951d9699766 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:53.341556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:10:53.342002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:10:53.342653 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:10:53.343216 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:10:53.343639 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:10:53.355541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:53.356219 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:53.357672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:53.358454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:53.386241 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Getting quotas for project c3d2b7b0783c4cc7bd0ce59a13f70efa. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:10:53.394419 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Getting quotas for user ebe4b3455a3d4139a1267da97bd83662 and project c3d2b7b0783c4cc7bd0ce59a13f70efa. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:10:53.417887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:10:53.420766 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:10:53.439497 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-78cc0242-4f0d-4ff2-8587-c951d9699766 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:53.451625 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-78cc0242-4f0d-4ff2-8587-c951d9699766 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.530803 Aug 01 14:10:53.452775 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 172/336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:52 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:53.458795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-172ab984-cdb6-400c-87be-b15a98cb90c6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:10:53.461749 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-172ab984-cdb6-400c-87be-b15a98cb90c6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:53.480466 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-172ab984-cdb6-400c-87be-b15a98cb90c6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:53.481397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-172ab984-cdb6-400c-87be-b15a98cb90c6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:53.482453 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-172ab984-cdb6-400c-87be-b15a98cb90c6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:53.483326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-172ab984-cdb6-400c-87be-b15a98cb90c6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:53.531361 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-415f73e3-0c17-40db-a45c-2a141c777eb1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.032424 Aug 01 14:10:53.542613 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 165/337] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:10:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:10:53.561023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-002a2a37-a716-4475-a077-2a8c914142b4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:53.561648 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-002a2a37-a716-4475-a077-2a8c914142b4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:53.574030 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-172ab984-cdb6-400c-87be-b15a98cb90c6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lazy-loading 'flavor' on Instance uuid e8fa6e78-136c-4153-a57c-926647075a19 {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:10:53.645333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-002a2a37-a716-4475-a077-2a8c914142b4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:53.659109 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-002a2a37-a716-4475-a077-2a8c914142b4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1238 microversion: 2.1 time: 0.107464 Aug 01 14:10:53.679470 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 166/338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:53 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1238 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:53.754977 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-172ab984-cdb6-400c-87be-b15a98cb90c6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19/action" status: 200 len: 32 microversion: 2.1 time: 0.300468 Aug 01 14:10:53.755715 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 173/339] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:10:53 2022] POST /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19/action => generated 32 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:10:53.767409 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-303813fe-bfda-452e-a3c2-ad3603c8c053 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:53.768324 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-303813fe-bfda-452e-a3c2-ad3603c8c053 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:53.781049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-303813fe-bfda-452e-a3c2-ad3603c8c053 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:53.781911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-303813fe-bfda-452e-a3c2-ad3603c8c053 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:53.783573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-303813fe-bfda-452e-a3c2-ad3603c8c053 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:53.788436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-303813fe-bfda-452e-a3c2-ad3603c8c053 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:54.152575 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-303813fe-bfda-452e-a3c2-ad3603c8c053 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:54.164324 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-303813fe-bfda-452e-a3c2-ad3603c8c053 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.401878 Aug 01 14:10:54.164965 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 167/340] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:53 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:54.477862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-015cfdfb-360d-4b84-ba30-8092fb275b29 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:54.478547 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-015cfdfb-360d-4b84-ba30-8092fb275b29 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:54.496584 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-015cfdfb-360d-4b84-ba30-8092fb275b29 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:54.499255 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-015cfdfb-360d-4b84-ba30-8092fb275b29 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:54.500242 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-015cfdfb-360d-4b84-ba30-8092fb275b29 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:54.517422 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-015cfdfb-360d-4b84-ba30-8092fb275b29 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:54.688086 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f0f08b5c-cc47-4279-a1ab-053614029acb tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:54.688814 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f0f08b5c-cc47-4279-a1ab-053614029acb tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:54.706287 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0f08b5c-cc47-4279-a1ab-053614029acb tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:54.717190 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0f08b5c-cc47-4279-a1ab-053614029acb tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:54.718087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0f08b5c-cc47-4279-a1ab-053614029acb tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:54.718499 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0f08b5c-cc47-4279-a1ab-053614029acb tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:54.750944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-015cfdfb-360d-4b84-ba30-8092fb275b29 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:54.763597 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-015cfdfb-360d-4b84-ba30-8092fb275b29 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.292928 Aug 01 14:10:54.765218 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 174/341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:54 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:54.877471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f0f08b5c-cc47-4279-a1ab-053614029acb tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:54.890928 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f0f08b5c-cc47-4279-a1ab-053614029acb tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.204275 Aug 01 14:10:54.892052 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 168/342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:54 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:55.185787 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-18953554-9e80-43c7-9c82-fe91dbf0c2b1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:55.186293 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-18953554-9e80-43c7-9c82-fe91dbf0c2b1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:55.192748 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-18953554-9e80-43c7-9c82-fe91dbf0c2b1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.193201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-18953554-9e80-43c7-9c82-fe91dbf0c2b1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:55.193982 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-18953554-9e80-43c7-9c82-fe91dbf0c2b1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.194405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-18953554-9e80-43c7-9c82-fe91dbf0c2b1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:55.393554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-18953554-9e80-43c7-9c82-fe91dbf0c2b1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:55.402497 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-18953554-9e80-43c7-9c82-fe91dbf0c2b1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.221276 Aug 01 14:10:55.405895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 175/343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:55 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:55.785774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-548b0c6e-a1d2-4bb3-88b1-4d649b898d1d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:55.786495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-548b0c6e-a1d2-4bb3-88b1-4d649b898d1d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:55.795398 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-548b0c6e-a1d2-4bb3-88b1-4d649b898d1d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.796162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-548b0c6e-a1d2-4bb3-88b1-4d649b898d1d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:55.797162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-548b0c6e-a1d2-4bb3-88b1-4d649b898d1d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.797932 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-548b0c6e-a1d2-4bb3-88b1-4d649b898d1d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:55.823972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:55.920006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d465796d-4a2d-4f8f-a604-58e254adc969 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:55.920794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d465796d-4a2d-4f8f-a604-58e254adc969 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:55.927688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:55.929143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=10 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:55.931769 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d465796d-4a2d-4f8f-a604-58e254adc969 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.932646 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d465796d-4a2d-4f8f-a604-58e254adc969 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:55.933808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d465796d-4a2d-4f8f-a604-58e254adc969 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:55.934465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d465796d-4a2d-4f8f-a604-58e254adc969 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:55.983105 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-548b0c6e-a1d2-4bb3-88b1-4d649b898d1d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:55.992635 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-548b0c6e-a1d2-4bb3-88b1-4d649b898d1d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.210781 Aug 01 14:10:55.994648 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 169/344] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:55 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:56.034554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d465796d-4a2d-4f8f-a604-58e254adc969 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:56.042603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d465796d-4a2d-4f8f-a604-58e254adc969 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.129590 Aug 01 14:10:56.043368 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 176/345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:55 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:56.430479 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a6d21db1-40cd-4f17-818e-096422841667 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:56.434917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a6d21db1-40cd-4f17-818e-096422841667 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:56.447464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6d21db1-40cd-4f17-818e-096422841667 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:56.451459 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6d21db1-40cd-4f17-818e-096422841667 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:56.452325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6d21db1-40cd-4f17-818e-096422841667 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:56.453243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a6d21db1-40cd-4f17-818e-096422841667 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:56.618194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a6d21db1-40cd-4f17-818e-096422841667 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:56.625729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a6d21db1-40cd-4f17-818e-096422841667 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.203528 Aug 01 14:10:56.626331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 170/346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:56 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:57.015393 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-123d2d61-d77d-4109-b576-d04358602753 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:57.016820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-123d2d61-d77d-4109-b576-d04358602753 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:57.024094 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-123d2d61-d77d-4109-b576-d04358602753 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:57.024573 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-123d2d61-d77d-4109-b576-d04358602753 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:57.025408 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-123d2d61-d77d-4109-b576-d04358602753 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:57.025849 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-123d2d61-d77d-4109-b576-d04358602753 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:57.064900 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fb396fe8-5dec-4069-acdf-ca8dd5c9ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:57.065824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb396fe8-5dec-4069-acdf-ca8dd5c9ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:57.072190 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb396fe8-5dec-4069-acdf-ca8dd5c9ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:57.073016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb396fe8-5dec-4069-acdf-ca8dd5c9ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:57.074035 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb396fe8-5dec-4069-acdf-ca8dd5c9ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:57.074687 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb396fe8-5dec-4069-acdf-ca8dd5c9ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:57.146179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb396fe8-5dec-4069-acdf-ca8dd5c9ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:57.165850 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fb396fe8-5dec-4069-acdf-ca8dd5c9ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.103707 Aug 01 14:10:57.167582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 171/347] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:57 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:57.192826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-123d2d61-d77d-4109-b576-d04358602753 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:57.200346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-123d2d61-d77d-4109-b576-d04358602753 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.189199 Aug 01 14:10:57.200941 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 177/348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:57 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:57.649353 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3f016b5b-3f7d-4fb6-8c4c-28a3cc4e5ad4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:57.650238 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3f016b5b-3f7d-4fb6-8c4c-28a3cc4e5ad4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:57.658377 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f016b5b-3f7d-4fb6-8c4c-28a3cc4e5ad4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:57.659078 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f016b5b-3f7d-4fb6-8c4c-28a3cc4e5ad4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:57.660049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f016b5b-3f7d-4fb6-8c4c-28a3cc4e5ad4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:57.660521 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f016b5b-3f7d-4fb6-8c4c-28a3cc4e5ad4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:57.827311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3f016b5b-3f7d-4fb6-8c4c-28a3cc4e5ad4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:57.833786 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3f016b5b-3f7d-4fb6-8c4c-28a3cc4e5ad4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.188885 Aug 01 14:10:57.834671 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 172/349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:57 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:58.188447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4b5491d3-3383-4611-bf75-d43d39113b16 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:58.189807 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4b5491d3-3383-4611-bf75-d43d39113b16 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:58.196578 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4b5491d3-3383-4611-bf75-d43d39113b16 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.197355 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4b5491d3-3383-4611-bf75-d43d39113b16 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:58.198343 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4b5491d3-3383-4611-bf75-d43d39113b16 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.198980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4b5491d3-3383-4611-bf75-d43d39113b16 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:58.222014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-48a78df9-2d87-43ef-853c-7a88a921ca19 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:58.222694 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-48a78df9-2d87-43ef-853c-7a88a921ca19 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:58.229370 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48a78df9-2d87-43ef-853c-7a88a921ca19 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.229962 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48a78df9-2d87-43ef-853c-7a88a921ca19 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:58.230795 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48a78df9-2d87-43ef-853c-7a88a921ca19 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.231296 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48a78df9-2d87-43ef-853c-7a88a921ca19 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:58.281532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4b5491d3-3383-4611-bf75-d43d39113b16 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:58.286529 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:58.292684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4b5491d3-3383-4611-bf75-d43d39113b16 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.107877 Aug 01 14:10:58.299425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 178/350] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:58 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:58.388448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-48a78df9-2d87-43ef-853c-7a88a921ca19 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:58.397067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-48a78df9-2d87-43ef-853c-7a88a921ca19 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.179077 Aug 01 14:10:58.397721 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 173/351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:58 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:10:58.857532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-38235bec-6e09-40fd-9048-7fbf1f966af4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:58.858291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-38235bec-6e09-40fd-9048-7fbf1f966af4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:58.867690 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38235bec-6e09-40fd-9048-7fbf1f966af4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.868139 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38235bec-6e09-40fd-9048-7fbf1f966af4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:58.868933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38235bec-6e09-40fd-9048-7fbf1f966af4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:58.869370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38235bec-6e09-40fd-9048-7fbf1f966af4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:59.055997 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-38235bec-6e09-40fd-9048-7fbf1f966af4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:59.065165 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-38235bec-6e09-40fd-9048-7fbf1f966af4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.213149 Aug 01 14:10:59.065918 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 179/352] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:58 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:59.314414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-286e35fd-040c-4018-a651-115efdf0b6e6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:59.315815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-286e35fd-040c-4018-a651-115efdf0b6e6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:59.332383 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-286e35fd-040c-4018-a651-115efdf0b6e6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:59.333269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-286e35fd-040c-4018-a651-115efdf0b6e6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:59.335043 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-286e35fd-040c-4018-a651-115efdf0b6e6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:59.337178 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-286e35fd-040c-4018-a651-115efdf0b6e6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:59.418350 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bd0e79e6-afd2-4f23-973b-4e9f730290b1 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:10:59.418965 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bd0e79e6-afd2-4f23-973b-4e9f730290b1 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:10:59.426991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bd0e79e6-afd2-4f23-973b-4e9f730290b1 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:59.427695 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bd0e79e6-afd2-4f23-973b-4e9f730290b1 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:59.428505 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bd0e79e6-afd2-4f23-973b-4e9f730290b1 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:10:59.428952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bd0e79e6-afd2-4f23-973b-4e9f730290b1 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:10:59.440202 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-286e35fd-040c-4018-a651-115efdf0b6e6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:59.449414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-286e35fd-040c-4018-a651-115efdf0b6e6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.139053 Aug 01 14:10:59.456291 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 174/353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:59 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:10:59.633010 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bd0e79e6-afd2-4f23-973b-4e9f730290b1 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:10:59.647565 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bd0e79e6-afd2-4f23-973b-4e9f730290b1 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.233058 Aug 01 14:10:59.653617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 180/354] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:10:59 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:00.087200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c782062e-606c-4e23-9871-208ea0dbaa75 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:00.088167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c782062e-606c-4e23-9871-208ea0dbaa75 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:00.112743 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c782062e-606c-4e23-9871-208ea0dbaa75 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.118623 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c782062e-606c-4e23-9871-208ea0dbaa75 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.124096 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c782062e-606c-4e23-9871-208ea0dbaa75 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.126033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c782062e-606c-4e23-9871-208ea0dbaa75 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.299677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c782062e-606c-4e23-9871-208ea0dbaa75 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:00.308225 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c782062e-606c-4e23-9871-208ea0dbaa75 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.225421 Aug 01 14:11:00.309024 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 175/355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:00 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:00.474823 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7714c0ec-a979-4391-9c72-ced0f3fb733a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:00.475378 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7714c0ec-a979-4391-9c72-ced0f3fb733a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:00.483338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7714c0ec-a979-4391-9c72-ced0f3fb733a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.483785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7714c0ec-a979-4391-9c72-ced0f3fb733a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.484607 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7714c0ec-a979-4391-9c72-ced0f3fb733a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.485053 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7714c0ec-a979-4391-9c72-ced0f3fb733a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.583169 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7714c0ec-a979-4391-9c72-ced0f3fb733a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:00.593947 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7714c0ec-a979-4391-9c72-ced0f3fb733a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.126259 Aug 01 14:11:00.594751 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 181/356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:00 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:00.675167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c64ea5a7-eee5-4dfa-b19c-81ac314b5abc tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:00.675798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c64ea5a7-eee5-4dfa-b19c-81ac314b5abc tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:00.681699 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c64ea5a7-eee5-4dfa-b19c-81ac314b5abc tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.682143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c64ea5a7-eee5-4dfa-b19c-81ac314b5abc tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.682946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c64ea5a7-eee5-4dfa-b19c-81ac314b5abc tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:00.683323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c64ea5a7-eee5-4dfa-b19c-81ac314b5abc tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:00.819194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c64ea5a7-eee5-4dfa-b19c-81ac314b5abc tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:00.826777 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c64ea5a7-eee5-4dfa-b19c-81ac314b5abc tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.155960 Aug 01 14:11:00.827335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 176/357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:00 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:01.337948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fe4da220-e70c-4cd2-9731-fd918f37dd8a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:01.338563 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fe4da220-e70c-4cd2-9731-fd918f37dd8a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:01.346671 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fe4da220-e70c-4cd2-9731-fd918f37dd8a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:01.347122 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fe4da220-e70c-4cd2-9731-fd918f37dd8a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:01.347902 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fe4da220-e70c-4cd2-9731-fd918f37dd8a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:01.348343 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fe4da220-e70c-4cd2-9731-fd918f37dd8a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:01.496163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fe4da220-e70c-4cd2-9731-fd918f37dd8a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:01.504800 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fe4da220-e70c-4cd2-9731-fd918f37dd8a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.175759 Aug 01 14:11:01.505469 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 182/358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:01 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:01.616799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-db7c754f-93c9-459b-9a0a-fd48d6df4338 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:01.617535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-db7c754f-93c9-459b-9a0a-fd48d6df4338 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:01.624414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db7c754f-93c9-459b-9a0a-fd48d6df4338 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:01.625541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db7c754f-93c9-459b-9a0a-fd48d6df4338 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:01.627358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db7c754f-93c9-459b-9a0a-fd48d6df4338 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:01.627986 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db7c754f-93c9-459b-9a0a-fd48d6df4338 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:01.693696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-db7c754f-93c9-459b-9a0a-fd48d6df4338 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:01.701524 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-db7c754f-93c9-459b-9a0a-fd48d6df4338 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.089677 Aug 01 14:11:01.702330 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 177/359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:01 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:01.847786 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ceb2dff7-b1ad-492c-a73b-7a44b436909a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:01.848416 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ceb2dff7-b1ad-492c-a73b-7a44b436909a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:01.855459 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ceb2dff7-b1ad-492c-a73b-7a44b436909a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:01.855963 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ceb2dff7-b1ad-492c-a73b-7a44b436909a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:01.856779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ceb2dff7-b1ad-492c-a73b-7a44b436909a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:01.857223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ceb2dff7-b1ad-492c-a73b-7a44b436909a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:02.005459 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ceb2dff7-b1ad-492c-a73b-7a44b436909a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:02.013216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ceb2dff7-b1ad-492c-a73b-7a44b436909a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.169844 Aug 01 14:11:02.013878 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 183/360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:01 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:02.526918 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-630d50f4-f58a-4c9f-b4a7-4543fbb3effa tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:02.527448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-630d50f4-f58a-4c9f-b4a7-4543fbb3effa tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:02.533981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-630d50f4-f58a-4c9f-b4a7-4543fbb3effa tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:02.534426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-630d50f4-f58a-4c9f-b4a7-4543fbb3effa tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:02.535212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-630d50f4-f58a-4c9f-b4a7-4543fbb3effa tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:02.535645 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-630d50f4-f58a-4c9f-b4a7-4543fbb3effa tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:02.664724 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-630d50f4-f58a-4c9f-b4a7-4543fbb3effa tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:02.672172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-630d50f4-f58a-4c9f-b4a7-4543fbb3effa tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.149259 Aug 01 14:11:02.672830 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 178/361] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:02 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:02.723856 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-30253551-0cc3-4407-a8b1-b6c718a86c82 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:02.724462 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-30253551-0cc3-4407-a8b1-b6c718a86c82 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:02.731258 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30253551-0cc3-4407-a8b1-b6c718a86c82 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:02.731725 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30253551-0cc3-4407-a8b1-b6c718a86c82 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:02.732598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30253551-0cc3-4407-a8b1-b6c718a86c82 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:02.733053 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30253551-0cc3-4407-a8b1-b6c718a86c82 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:02.794297 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-30253551-0cc3-4407-a8b1-b6c718a86c82 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:02.801730 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-30253551-0cc3-4407-a8b1-b6c718a86c82 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.082224 Aug 01 14:11:02.802405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 184/362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:02 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:03.034832 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c2025789-dfe2-43ff-bb88-f556c14fcc06 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:03.035441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c2025789-dfe2-43ff-bb88-f556c14fcc06 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:03.041445 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c2025789-dfe2-43ff-bb88-f556c14fcc06 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:03.041939 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c2025789-dfe2-43ff-bb88-f556c14fcc06 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:03.042650 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c2025789-dfe2-43ff-bb88-f556c14fcc06 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:03.043087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c2025789-dfe2-43ff-bb88-f556c14fcc06 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:03.170523 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c2025789-dfe2-43ff-bb88-f556c14fcc06 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:03.177950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c2025789-dfe2-43ff-bb88-f556c14fcc06 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.147015 Aug 01 14:11:03.178516 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 179/363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:03 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:03.694172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-285c4767-5660-48f8-bbcb-4472ca21e51a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:03.694813 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-285c4767-5660-48f8-bbcb-4472ca21e51a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:03.700871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-285c4767-5660-48f8-bbcb-4472ca21e51a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:03.701318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-285c4767-5660-48f8-bbcb-4472ca21e51a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:03.702077 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-285c4767-5660-48f8-bbcb-4472ca21e51a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:03.702515 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-285c4767-5660-48f8-bbcb-4472ca21e51a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:03.822692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-003ddb56-6fe0-4928-9020-d9f7c1cced52 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:03.823390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-003ddb56-6fe0-4928-9020-d9f7c1cced52 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:03.827852 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:03.828716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=14 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:03.834935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-003ddb56-6fe0-4928-9020-d9f7c1cced52 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:03.835385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-003ddb56-6fe0-4928-9020-d9f7c1cced52 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:03.836180 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-003ddb56-6fe0-4928-9020-d9f7c1cced52 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:03.836650 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-003ddb56-6fe0-4928-9020-d9f7c1cced52 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:03.846659 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-285c4767-5660-48f8-bbcb-4472ca21e51a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:03.854767 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-285c4767-5660-48f8-bbcb-4472ca21e51a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.164461 Aug 01 14:11:03.855339 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 185/364] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:03 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:03.901432 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-003ddb56-6fe0-4928-9020-d9f7c1cced52 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:03.912265 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-003ddb56-6fe0-4928-9020-d9f7c1cced52 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.093552 Aug 01 14:11:03.912904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 180/365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:03 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:04.199187 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ad1ec6c2-0e2a-4afe-a5c7-a20f022fa431 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:04.199693 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ad1ec6c2-0e2a-4afe-a5c7-a20f022fa431 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:04.206398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ad1ec6c2-0e2a-4afe-a5c7-a20f022fa431 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:04.206838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ad1ec6c2-0e2a-4afe-a5c7-a20f022fa431 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:04.207585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ad1ec6c2-0e2a-4afe-a5c7-a20f022fa431 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:04.208013 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ad1ec6c2-0e2a-4afe-a5c7-a20f022fa431 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:04.339472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ad1ec6c2-0e2a-4afe-a5c7-a20f022fa431 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:04.347363 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ad1ec6c2-0e2a-4afe-a5c7-a20f022fa431 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.152088 Aug 01 14:11:04.347918 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 186/366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:04 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:04.876457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-78a77699-4b9d-43a1-8d5f-3b28a4eb2b2b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:04.877107 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-78a77699-4b9d-43a1-8d5f-3b28a4eb2b2b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:04.883234 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78a77699-4b9d-43a1-8d5f-3b28a4eb2b2b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:04.883683 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78a77699-4b9d-43a1-8d5f-3b28a4eb2b2b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:04.884450 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78a77699-4b9d-43a1-8d5f-3b28a4eb2b2b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:04.884912 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78a77699-4b9d-43a1-8d5f-3b28a4eb2b2b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:04.933803 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fefcc685-98d0-4b56-b6d8-53a9c33f87ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:04.934419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fefcc685-98d0-4b56-b6d8-53a9c33f87ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:04.941636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fefcc685-98d0-4b56-b6d8-53a9c33f87ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:04.942031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fefcc685-98d0-4b56-b6d8-53a9c33f87ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:04.942802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fefcc685-98d0-4b56-b6d8-53a9c33f87ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:04.943243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fefcc685-98d0-4b56-b6d8-53a9c33f87ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:05.006625 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fefcc685-98d0-4b56-b6d8-53a9c33f87ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:05.014050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fefcc685-98d0-4b56-b6d8-53a9c33f87ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.084101 Aug 01 14:11:05.014828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 187/367] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:04 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:05.015604 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-78a77699-4b9d-43a1-8d5f-3b28a4eb2b2b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:05.023285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-78a77699-4b9d-43a1-8d5f-3b28a4eb2b2b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.151238 Aug 01 14:11:05.023846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 181/368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:04 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:05.368500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c076e9e8-9f4d-4cb6-a2ad-a7d884448abe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:05.369130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c076e9e8-9f4d-4cb6-a2ad-a7d884448abe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:05.375272 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c076e9e8-9f4d-4cb6-a2ad-a7d884448abe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:05.375723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c076e9e8-9f4d-4cb6-a2ad-a7d884448abe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:05.376504 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c076e9e8-9f4d-4cb6-a2ad-a7d884448abe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:05.376952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c076e9e8-9f4d-4cb6-a2ad-a7d884448abe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:05.506351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c076e9e8-9f4d-4cb6-a2ad-a7d884448abe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:05.513772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c076e9e8-9f4d-4cb6-a2ad-a7d884448abe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.149222 Aug 01 14:11:05.514339 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 188/369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:05 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:06.034950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7452d2cd-3b6f-4496-bb46-d17961bca048 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:06.035569 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7452d2cd-3b6f-4496-bb46-d17961bca048 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:06.041829 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7452d2cd-3b6f-4496-bb46-d17961bca048 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:06.042281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7452d2cd-3b6f-4496-bb46-d17961bca048 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:06.043052 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7452d2cd-3b6f-4496-bb46-d17961bca048 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:06.043183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8e50fc6d-a04f-42a6-889d-9bdfa31095b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:06.043573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7452d2cd-3b6f-4496-bb46-d17961bca048 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:06.043805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8e50fc6d-a04f-42a6-889d-9bdfa31095b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:06.050493 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8e50fc6d-a04f-42a6-889d-9bdfa31095b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:06.050942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8e50fc6d-a04f-42a6-889d-9bdfa31095b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:06.051708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8e50fc6d-a04f-42a6-889d-9bdfa31095b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:06.052145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8e50fc6d-a04f-42a6-889d-9bdfa31095b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:06.105889 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7452d2cd-3b6f-4496-bb46-d17961bca048 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:06.113431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7452d2cd-3b6f-4496-bb46-d17961bca048 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.082335 Aug 01 14:11:06.114006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 182/370] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:06 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:06.183464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8e50fc6d-a04f-42a6-889d-9bdfa31095b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:06.193215 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8e50fc6d-a04f-42a6-889d-9bdfa31095b5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.153635 Aug 01 14:11:06.194360 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 189/371] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:06 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:06.534854 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1df056e4-9885-419e-82d8-c6b83c6f1597 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:06.535467 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1df056e4-9885-419e-82d8-c6b83c6f1597 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:06.542117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1df056e4-9885-419e-82d8-c6b83c6f1597 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:06.542572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1df056e4-9885-419e-82d8-c6b83c6f1597 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:06.543494 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1df056e4-9885-419e-82d8-c6b83c6f1597 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:06.543986 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1df056e4-9885-419e-82d8-c6b83c6f1597 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:06.675640 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1df056e4-9885-419e-82d8-c6b83c6f1597 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:06.683023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1df056e4-9885-419e-82d8-c6b83c6f1597 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.152067 Aug 01 14:11:06.683587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 183/372] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:06 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:07.135136 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d5a04660-f1f5-4308-a86e-e37da15fe651 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:07.135836 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d5a04660-f1f5-4308-a86e-e37da15fe651 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:07.143574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5a04660-f1f5-4308-a86e-e37da15fe651 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:07.144142 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5a04660-f1f5-4308-a86e-e37da15fe651 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:07.145013 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5a04660-f1f5-4308-a86e-e37da15fe651 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:07.145521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5a04660-f1f5-4308-a86e-e37da15fe651 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:07.212241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d5a04660-f1f5-4308-a86e-e37da15fe651 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:07.215789 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-76819d0e-7d89-4ba6-ab10-a6a77fe3fbc1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:07.216471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-76819d0e-7d89-4ba6-ab10-a6a77fe3fbc1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:07.222038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d5a04660-f1f5-4308-a86e-e37da15fe651 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1242 microversion: 2.1 time: 0.090869 Aug 01 14:11:07.222994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 190/373] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:07 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:07.224147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76819d0e-7d89-4ba6-ab10-a6a77fe3fbc1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:07.224628 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76819d0e-7d89-4ba6-ab10-a6a77fe3fbc1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:07.225402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76819d0e-7d89-4ba6-ab10-a6a77fe3fbc1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:07.225839 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76819d0e-7d89-4ba6-ab10-a6a77fe3fbc1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:07.354262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-76819d0e-7d89-4ba6-ab10-a6a77fe3fbc1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:07.361825 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-76819d0e-7d89-4ba6-ab10-a6a77fe3fbc1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.150383 Aug 01 14:11:07.362395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 184/374] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:07 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:07.703865 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8d92a216-a894-4568-88dd-c78bdf5f625c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:07.705209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8d92a216-a894-4568-88dd-c78bdf5f625c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:07.711443 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d92a216-a894-4568-88dd-c78bdf5f625c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:07.711972 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d92a216-a894-4568-88dd-c78bdf5f625c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:07.712839 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d92a216-a894-4568-88dd-c78bdf5f625c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:07.713279 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d92a216-a894-4568-88dd-c78bdf5f625c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:07.849658 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8d92a216-a894-4568-88dd-c78bdf5f625c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:07.858400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8d92a216-a894-4568-88dd-c78bdf5f625c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.158239 Aug 01 14:11:07.858984 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 191/375] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:07 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:08.242802 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ebe9901a-bd52-4dee-82e8-3b85510984c6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:08.243412 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ebe9901a-bd52-4dee-82e8-3b85510984c6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:08.249439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebe9901a-bd52-4dee-82e8-3b85510984c6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:08.249890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebe9901a-bd52-4dee-82e8-3b85510984c6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.250658 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebe9901a-bd52-4dee-82e8-3b85510984c6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:08.251636 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebe9901a-bd52-4dee-82e8-3b85510984c6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.311284 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ebe9901a-bd52-4dee-82e8-3b85510984c6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:08.319220 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ebe9901a-bd52-4dee-82e8-3b85510984c6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1290 microversion: 2.1 time: 0.080497 Aug 01 14:11:08.319788 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 185/376] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:08 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:08.382364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-16c3b57f-d6ce-4f57-a5b2-3b28a72ab72f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:08.382979 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-16c3b57f-d6ce-4f57-a5b2-3b28a72ab72f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:08.389645 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-16c3b57f-d6ce-4f57-a5b2-3b28a72ab72f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:08.390104 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-16c3b57f-d6ce-4f57-a5b2-3b28a72ab72f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.390864 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-16c3b57f-d6ce-4f57-a5b2-3b28a72ab72f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:08.391305 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-16c3b57f-d6ce-4f57-a5b2-3b28a72ab72f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.524396 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-16c3b57f-d6ce-4f57-a5b2-3b28a72ab72f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:08.531766 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-16c3b57f-d6ce-4f57-a5b2-3b28a72ab72f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.153207 Aug 01 14:11:08.532382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 192/377] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:08 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:08.882276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f28b4283-92cd-454d-922f-a8f3550e6283 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:08.882884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f28b4283-92cd-454d-922f-a8f3550e6283 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:08.889101 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f28b4283-92cd-454d-922f-a8f3550e6283 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:08.889580 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f28b4283-92cd-454d-922f-a8f3550e6283 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.890380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f28b4283-92cd-454d-922f-a8f3550e6283 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:08.890817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f28b4283-92cd-454d-922f-a8f3550e6283 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:08.894835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:09.019539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f28b4283-92cd-454d-922f-a8f3550e6283 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:09.027045 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f28b4283-92cd-454d-922f-a8f3550e6283 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.148707 Aug 01 14:11:09.027607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 186/378] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:08 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:09.340163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6affa01f-b647-48c8-9d29-5ffedf4f0173 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:09.340813 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6affa01f-b647-48c8-9d29-5ffedf4f0173 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:09.347514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6affa01f-b647-48c8-9d29-5ffedf4f0173 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:09.347968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6affa01f-b647-48c8-9d29-5ffedf4f0173 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:09.348760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6affa01f-b647-48c8-9d29-5ffedf4f0173 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:09.349205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6affa01f-b647-48c8-9d29-5ffedf4f0173 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:09.410208 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6affa01f-b647-48c8-9d29-5ffedf4f0173 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:09.417870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6affa01f-b647-48c8-9d29-5ffedf4f0173 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1290 microversion: 2.1 time: 0.081731 Aug 01 14:11:09.418440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 193/379] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:09 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:09.554119 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-67339b4c-1f59-4aaa-86c4-3760537a8f93 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:09.555700 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-67339b4c-1f59-4aaa-86c4-3760537a8f93 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:09.561905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67339b4c-1f59-4aaa-86c4-3760537a8f93 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:09.562348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67339b4c-1f59-4aaa-86c4-3760537a8f93 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:09.563103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67339b4c-1f59-4aaa-86c4-3760537a8f93 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:09.563554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-67339b4c-1f59-4aaa-86c4-3760537a8f93 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:09.694848 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-67339b4c-1f59-4aaa-86c4-3760537a8f93 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:09.702168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-67339b4c-1f59-4aaa-86c4-3760537a8f93 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.152270 Aug 01 14:11:09.702721 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 187/380] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:09 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:10.048792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bbb641fe-3862-44a1-80ca-17333099927f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:10.049555 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bbb641fe-3862-44a1-80ca-17333099927f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:10.055747 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbb641fe-3862-44a1-80ca-17333099927f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.056223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbb641fe-3862-44a1-80ca-17333099927f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.056998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbb641fe-3862-44a1-80ca-17333099927f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.057450 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bbb641fe-3862-44a1-80ca-17333099927f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.184040 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bbb641fe-3862-44a1-80ca-17333099927f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:10.192784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bbb641fe-3862-44a1-80ca-17333099927f tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.148416 Aug 01 14:11:10.193423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 194/381] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:10 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:10.438278 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a7bc5f4-7450-4d9b-b453-b5bbcb95af72 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:10.438952 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a7bc5f4-7450-4d9b-b453-b5bbcb95af72 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:10.444935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a7bc5f4-7450-4d9b-b453-b5bbcb95af72 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.445389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a7bc5f4-7450-4d9b-b453-b5bbcb95af72 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.446154 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a7bc5f4-7450-4d9b-b453-b5bbcb95af72 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.446592 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a7bc5f4-7450-4d9b-b453-b5bbcb95af72 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.507448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a7bc5f4-7450-4d9b-b453-b5bbcb95af72 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:10.514814 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a7bc5f4-7450-4d9b-b453-b5bbcb95af72 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1290 microversion: 2.1 time: 0.080394 Aug 01 14:11:10.515376 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 188/382] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:10 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1290 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:10.723856 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1c50d87a-a614-4087-a819-2f82adee0971 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:10.724463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1c50d87a-a614-4087-a819-2f82adee0971 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:10.730939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1c50d87a-a614-4087-a819-2f82adee0971 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.731382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1c50d87a-a614-4087-a819-2f82adee0971 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.732144 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1c50d87a-a614-4087-a819-2f82adee0971 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:10.732611 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1c50d87a-a614-4087-a819-2f82adee0971 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:10.750799 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:10.865307 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1c50d87a-a614-4087-a819-2f82adee0971 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:10.872952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1c50d87a-a614-4087-a819-2f82adee0971 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.153206 Aug 01 14:11:10.873503 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 195/383] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:10 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:11.171146 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-332015686", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "networks": [{"uuid": "cfc563f9-7943-4af8-8703-0d6ce2775d5f"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:11.214571 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d0ef222b-bdb8-4a38-bd32-16a8ab8dddcd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:11.215191 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d0ef222b-bdb8-4a38-bd32-16a8ab8dddcd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:11.221506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d0ef222b-bdb8-4a38-bd32-16a8ab8dddcd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.221961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d0ef222b-bdb8-4a38-bd32-16a8ab8dddcd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.222342 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] validate_networks() for [('cfc563f9-7943-4af8-8703-0d6ce2775d5f', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:11:11.222733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d0ef222b-bdb8-4a38-bd32-16a8ab8dddcd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.223174 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d0ef222b-bdb8-4a38-bd32-16a8ab8dddcd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.363443 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d0ef222b-bdb8-4a38-bd32-16a8ab8dddcd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:11.371054 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d0ef222b-bdb8-4a38-bd32-16a8ab8dddcd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.161052 Aug 01 14:11:11.371627 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 196/384] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:11 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:11.535569 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dc26c036-455f-4dc9-bed8-66f4a7fba20f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:11.536272 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dc26c036-455f-4dc9-bed8-66f4a7fba20f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:11.542459 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc26c036-455f-4dc9-bed8-66f4a7fba20f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.542983 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc26c036-455f-4dc9-bed8-66f4a7fba20f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.543824 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc26c036-455f-4dc9-bed8-66f4a7fba20f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.544327 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc26c036-455f-4dc9-bed8-66f4a7fba20f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.581255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:11:11.581679 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:11:11.582150 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:11:11.582562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:11:11.582968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:11:11.593070 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.593529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.594994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.595331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.612359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dc26c036-455f-4dc9-bed8-66f4a7fba20f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:11.616455 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Getting quotas for project 99a2e6e5b9974029a065bd70058dc8be. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:11.620314 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Getting quotas for user 1d54f339d88a4f8c9ef914497ce3138d and project 99a2e6e5b9974029a065bd70058dc8be. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:11.620435 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dc26c036-455f-4dc9-bed8-66f4a7fba20f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1290 microversion: 2.1 time: 0.089112 Aug 01 14:11:11.620923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 197/385] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:11 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1290 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:11.631386 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:11:11.633529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:11:11.678033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bb3d76d4-c59a-41b0-ad67-1baf2a9928d1 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.510582 Aug 01 14:11:11.678672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 189/386] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:11:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:11:11.689679 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-84cad000-fe25-4498-90f4-36c5033de6ea tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:11.690290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-84cad000-fe25-4498-90f4-36c5033de6ea tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:11.759366 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-84cad000-fe25-4498-90f4-36c5033de6ea tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:11.766053 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-84cad000-fe25-4498-90f4-36c5033de6ea tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1218 microversion: 2.1 time: 0.080559 Aug 01 14:11:11.767164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 198/387] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:11 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:11.894709 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9a9d9a32-6abb-40f5-965f-bcbfad820f48 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:11.895415 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9a9d9a32-6abb-40f5-965f-bcbfad820f48 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:11.901488 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a9d9a32-6abb-40f5-965f-bcbfad820f48 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.901934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a9d9a32-6abb-40f5-965f-bcbfad820f48 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:11.902695 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a9d9a32-6abb-40f5-965f-bcbfad820f48 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:11.903129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a9d9a32-6abb-40f5-965f-bcbfad820f48 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.045703 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9a9d9a32-6abb-40f5-965f-bcbfad820f48 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:12.054419 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9a9d9a32-6abb-40f5-965f-bcbfad820f48 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.164108 Aug 01 14:11:12.054998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 190/388] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:11 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:12.392292 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-59fab3c7-0615-43d2-a4b4-c982d6bcd707 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:12.392931 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-59fab3c7-0615-43d2-a4b4-c982d6bcd707 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:12.398935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-59fab3c7-0615-43d2-a4b4-c982d6bcd707 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.399378 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-59fab3c7-0615-43d2-a4b4-c982d6bcd707 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.400129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-59fab3c7-0615-43d2-a4b4-c982d6bcd707 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.400582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-59fab3c7-0615-43d2-a4b4-c982d6bcd707 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.526540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-59fab3c7-0615-43d2-a4b4-c982d6bcd707 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:12.533874 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-59fab3c7-0615-43d2-a4b4-c982d6bcd707 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.145421 Aug 01 14:11:12.534422 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 199/389] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:12 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:12.644428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a2a2bca8-a53b-4dc8-878a-a85dd7bc3244 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:12.645067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a2a2bca8-a53b-4dc8-878a-a85dd7bc3244 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:12.651038 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2a2bca8-a53b-4dc8-878a-a85dd7bc3244 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.651490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2a2bca8-a53b-4dc8-878a-a85dd7bc3244 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.652254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2a2bca8-a53b-4dc8-878a-a85dd7bc3244 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.652729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2a2bca8-a53b-4dc8-878a-a85dd7bc3244 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.717271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a2a2bca8-a53b-4dc8-878a-a85dd7bc3244 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:12.726517 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a2a2bca8-a53b-4dc8-878a-a85dd7bc3244 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1290 microversion: 2.1 time: 0.084675 Aug 01 14:11:12.727314 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 191/390] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:12 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1290 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:12.787376 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-482583e1-25af-4098-aca8-aec565502d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:12.787988 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-482583e1-25af-4098-aca8-aec565502d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:12.794645 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-482583e1-25af-4098-aca8-aec565502d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.795101 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-482583e1-25af-4098-aca8-aec565502d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.795902 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-482583e1-25af-4098-aca8-aec565502d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:12.796679 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-482583e1-25af-4098-aca8-aec565502d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:12.880265 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-482583e1-25af-4098-aca8-aec565502d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:12.890316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-482583e1-25af-4098-aca8-aec565502d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1222 microversion: 2.1 time: 0.106241 Aug 01 14:11:12.903101 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 200/391] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:12 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:13.083894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f152b9c5-a0fd-42d9-94d3-82ca19a2092c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:13.084820 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f152b9c5-a0fd-42d9-94d3-82ca19a2092c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:13.091945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f152b9c5-a0fd-42d9-94d3-82ca19a2092c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.092677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f152b9c5-a0fd-42d9-94d3-82ca19a2092c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.093536 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f152b9c5-a0fd-42d9-94d3-82ca19a2092c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.094099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f152b9c5-a0fd-42d9-94d3-82ca19a2092c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.353714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f152b9c5-a0fd-42d9-94d3-82ca19a2092c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:13.361243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f152b9c5-a0fd-42d9-94d3-82ca19a2092c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.281353 Aug 01 14:11:13.361801 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 192/392] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:13 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:13.554260 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9de173b2-c0a9-4f2d-8f35-e76a80d3cf9d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:13.554911 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9de173b2-c0a9-4f2d-8f35-e76a80d3cf9d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:13.561050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9de173b2-c0a9-4f2d-8f35-e76a80d3cf9d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.561502 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9de173b2-c0a9-4f2d-8f35-e76a80d3cf9d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.562267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9de173b2-c0a9-4f2d-8f35-e76a80d3cf9d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.562708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9de173b2-c0a9-4f2d-8f35-e76a80d3cf9d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.701562 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9de173b2-c0a9-4f2d-8f35-e76a80d3cf9d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:13.709978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9de173b2-c0a9-4f2d-8f35-e76a80d3cf9d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.159512 Aug 01 14:11:13.710770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 201/393] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:13 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:13.747186 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0ef90a12-659f-4ea2-b1a3-87f017084e64 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:13.747955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0ef90a12-659f-4ea2-b1a3-87f017084e64 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:13.754903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ef90a12-659f-4ea2-b1a3-87f017084e64 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.755357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ef90a12-659f-4ea2-b1a3-87f017084e64 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.756137 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ef90a12-659f-4ea2-b1a3-87f017084e64 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.756605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ef90a12-659f-4ea2-b1a3-87f017084e64 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.819342 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0ef90a12-659f-4ea2-b1a3-87f017084e64 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:13.827211 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0ef90a12-659f-4ea2-b1a3-87f017084e64 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1296 microversion: 2.1 time: 0.083904 Aug 01 14:11:13.827772 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 193/394] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:13 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1296 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:13.910817 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0beb6012-4d55-4b3f-95d5-eaa51410bf56 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:13.912454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0beb6012-4d55-4b3f-95d5-eaa51410bf56 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:13.920329 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0beb6012-4d55-4b3f-95d5-eaa51410bf56 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.920840 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0beb6012-4d55-4b3f-95d5-eaa51410bf56 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:13.921653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0beb6012-4d55-4b3f-95d5-eaa51410bf56 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:13.922094 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0beb6012-4d55-4b3f-95d5-eaa51410bf56 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.051230 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0beb6012-4d55-4b3f-95d5-eaa51410bf56 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:14.064110 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0beb6012-4d55-4b3f-95d5-eaa51410bf56 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1278 microversion: 2.1 time: 0.157373 Aug 01 14:11:14.065015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 202/395] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:13 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1278 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:14.383285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d1a33b74-55b4-48c0-863a-d3cdc4526a4a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:14.383981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d1a33b74-55b4-48c0-863a-d3cdc4526a4a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:14.389895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1a33b74-55b4-48c0-863a-d3cdc4526a4a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.390417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1a33b74-55b4-48c0-863a-d3cdc4526a4a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.391297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1a33b74-55b4-48c0-863a-d3cdc4526a4a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.391792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1a33b74-55b4-48c0-863a-d3cdc4526a4a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.650187 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d1a33b74-55b4-48c0-863a-d3cdc4526a4a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:14.659963 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d1a33b74-55b4-48c0-863a-d3cdc4526a4a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.280571 Aug 01 14:11:14.660567 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 194/396] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:14 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:14.732186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-78443079-36c0-43ef-b137-1235264558ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:14.732905 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-78443079-36c0-43ef-b137-1235264558ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:14.757050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78443079-36c0-43ef-b137-1235264558ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.757499 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78443079-36c0-43ef-b137-1235264558ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.758278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78443079-36c0-43ef-b137-1235264558ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.758713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78443079-36c0-43ef-b137-1235264558ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.850342 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1166e439-dc0f-4225-887e-b44455b2cfb7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:14.850954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1166e439-dc0f-4225-887e-b44455b2cfb7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:14.857605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1166e439-dc0f-4225-887e-b44455b2cfb7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.858509 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1166e439-dc0f-4225-887e-b44455b2cfb7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:14.859457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1166e439-dc0f-4225-887e-b44455b2cfb7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:14.860193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1166e439-dc0f-4225-887e-b44455b2cfb7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.363476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1166e439-dc0f-4225-887e-b44455b2cfb7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:15.376110 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1166e439-dc0f-4225-887e-b44455b2cfb7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.530000 Aug 01 14:11:15.377061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 195/397] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:14 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:15.386163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b53c571b-29bf-4bfa-96e9-767e896bf9ac tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:15.389429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b53c571b-29bf-4bfa-96e9-767e896bf9ac tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:15.390193 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-78443079-36c0-43ef-b137-1235264558ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:15.399554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-78443079-36c0-43ef-b137-1235264558ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.672156 Aug 01 14:11:15.414623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 203/398] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:14 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:15.414817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b53c571b-29bf-4bfa-96e9-767e896bf9ac tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.415223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b53c571b-29bf-4bfa-96e9-767e896bf9ac tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.416200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b53c571b-29bf-4bfa-96e9-767e896bf9ac tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.416780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b53c571b-29bf-4bfa-96e9-767e896bf9ac tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.420593 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-ab7066a4-4d30-4e16-b7f4-8dc379dc5771 req-2c27f5cb-1f87-44e1-849b-bf13b5ffd285 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b0b1caa-a17e-4a0f-b54e-9d0be62f316d", "name": "network-vif-plugged", "status": "completed", "tag": "49a0f089-f785-418c-9210-780bc0f62f14"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:15.440057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-ab7066a4-4d30-4e16-b7f4-8dc379dc5771 req-2c27f5cb-1f87-44e1-849b-bf13b5ffd285 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.441659 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-ab7066a4-4d30-4e16-b7f4-8dc379dc5771 req-2c27f5cb-1f87-44e1-849b-bf13b5ffd285 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.459823 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-ab7066a4-4d30-4e16-b7f4-8dc379dc5771 req-2c27f5cb-1f87-44e1-849b-bf13b5ffd285 service nova] Creating event network-vif-plugged:49a0f089-f785-418c-9210-780bc0f62f14 for instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d on hv-cinder-84713 Aug 01 14:11:15.466897 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-ab7066a4-4d30-4e16-b7f4-8dc379dc5771 req-2c27f5cb-1f87-44e1-849b-bf13b5ffd285 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050351 Aug 01 14:11:15.467863 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 204/399] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:15.626430 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b53c571b-29bf-4bfa-96e9-767e896bf9ac tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:15.635759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b53c571b-29bf-4bfa-96e9-767e896bf9ac tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.256975 Aug 01 14:11:15.652661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 196/400] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:15 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:15.683031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e5e40839-1dfb-43ef-bc74-5413b80f200d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:15.683688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e5e40839-1dfb-43ef-bc74-5413b80f200d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:15.693942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e5e40839-1dfb-43ef-bc74-5413b80f200d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.694736 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e5e40839-1dfb-43ef-bc74-5413b80f200d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.695792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e5e40839-1dfb-43ef-bc74-5413b80f200d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:15.696686 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e5e40839-1dfb-43ef-bc74-5413b80f200d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:15.951339 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e5e40839-1dfb-43ef-bc74-5413b80f200d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:15.961007 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e5e40839-1dfb-43ef-bc74-5413b80f200d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.283289 Aug 01 14:11:15.975743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 205/401] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:15 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:15.997554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-1e7ba860-53f9-4e17-a137-599f97374948 req-b8e15162-b08f-4f30-817b-e9af648a31df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5922be0-946e-4dff-b598-80a7ff1433d3", "tag": "20f75126-d096-4a15-ba80-92b6596dcd7c"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:16.003374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:16.009691 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1e7ba860-53f9-4e17-a137-599f97374948 req-b8e15162-b08f-4f30-817b-e9af648a31df service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.010268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1e7ba860-53f9-4e17-a137-599f97374948 req-b8e15162-b08f-4f30-817b-e9af648a31df service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.026496 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-27819f57-02dc-465c-9e89-05e1b516e556 req-b220f04b-c9fb-499b-aa4f-89e85bc7de0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb60b84-0a48-4c71-90d0-bb0ad32e66a3", "tag": "ca8de692-90c9-403a-8384-f27a86a2d499"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:16.028368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-1e7ba860-53f9-4e17-a137-599f97374948 req-b8e15162-b08f-4f30-817b-e9af648a31df service nova] Creating event network-changed:20f75126-d096-4a15-ba80-92b6596dcd7c for instance f5922be0-946e-4dff-b598-80a7ff1433d3 on hv-cinder-84713 Aug 01 14:11:16.033922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-1e7ba860-53f9-4e17-a137-599f97374948 req-b8e15162-b08f-4f30-817b-e9af648a31df service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041034 Aug 01 14:11:16.034654 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 197/402] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:16.038705 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-27819f57-02dc-465c-9e89-05e1b516e556 req-b220f04b-c9fb-499b-aa4f-89e85bc7de0d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.039213 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-27819f57-02dc-465c-9e89-05e1b516e556 req-b220f04b-c9fb-499b-aa4f-89e85bc7de0d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.050957 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-27819f57-02dc-465c-9e89-05e1b516e556 req-b220f04b-c9fb-499b-aa4f-89e85bc7de0d service nova] Creating event network-changed:ca8de692-90c9-403a-8384-f27a86a2d499 for instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 on hv-cinder-84713 Aug 01 14:11:16.055847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-27819f57-02dc-465c-9e89-05e1b516e556 req-b220f04b-c9fb-499b-aa4f-89e85bc7de0d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036050 Aug 01 14:11:16.056280 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 206/403] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:16.397979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c728ada9-5f9b-485f-84fc-d78e2bf4d85f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:16.398683 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c728ada9-5f9b-485f-84fc-d78e2bf4d85f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:16.405525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c728ada9-5f9b-485f-84fc-d78e2bf4d85f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.406004 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c728ada9-5f9b-485f-84fc-d78e2bf4d85f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.407438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c728ada9-5f9b-485f-84fc-d78e2bf4d85f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.407882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c728ada9-5f9b-485f-84fc-d78e2bf4d85f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.424863 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f7bdc2fd-753b-4c7a-b375-33a9b1e3f011 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:16.425573 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f7bdc2fd-753b-4c7a-b375-33a9b1e3f011 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:16.431824 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f7bdc2fd-753b-4c7a-b375-33a9b1e3f011 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.432278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f7bdc2fd-753b-4c7a-b375-33a9b1e3f011 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.433111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f7bdc2fd-753b-4c7a-b375-33a9b1e3f011 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.433552 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f7bdc2fd-753b-4c7a-b375-33a9b1e3f011 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.538429 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c728ada9-5f9b-485f-84fc-d78e2bf4d85f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:16.545946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c728ada9-5f9b-485f-84fc-d78e2bf4d85f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.152282 Aug 01 14:11:16.546517 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 198/404] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:16 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:16.564900 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f7bdc2fd-753b-4c7a-b375-33a9b1e3f011 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:16.572347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f7bdc2fd-753b-4c7a-b375-33a9b1e3f011 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.151854 Aug 01 14:11:16.572941 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 207/405] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:16 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:16.656787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8878a4f4-ebc0-4216-abd1-1f4354485e0a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:16.657401 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8878a4f4-ebc0-4216-abd1-1f4354485e0a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:16.663439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8878a4f4-ebc0-4216-abd1-1f4354485e0a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.663973 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8878a4f4-ebc0-4216-abd1-1f4354485e0a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.664755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8878a4f4-ebc0-4216-abd1-1f4354485e0a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.665236 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8878a4f4-ebc0-4216-abd1-1f4354485e0a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.795002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8878a4f4-ebc0-4216-abd1-1f4354485e0a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:16.803033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8878a4f4-ebc0-4216-abd1-1f4354485e0a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.150182 Aug 01 14:11:16.803621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 199/406] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:16 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:16.982621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-09104464-66d0-405c-a99e-e611eb4721a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:16.983149 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-09104464-66d0-405c-a99e-e611eb4721a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:16.990147 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09104464-66d0-405c-a99e-e611eb4721a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.990605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09104464-66d0-405c-a99e-e611eb4721a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:16.991374 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09104464-66d0-405c-a99e-e611eb4721a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:16.991817 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09104464-66d0-405c-a99e-e611eb4721a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.120806 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-09104464-66d0-405c-a99e-e611eb4721a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:17.128810 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-09104464-66d0-405c-a99e-e611eb4721a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.150156 Aug 01 14:11:17.129378 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 208/407] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:16 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:17.567239 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1bbd0840-7cc6-4c47-a3d9-1cf135d01612 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:17.567876 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1bbd0840-7cc6-4c47-a3d9-1cf135d01612 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:17.573922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bbd0840-7cc6-4c47-a3d9-1cf135d01612 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.574368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bbd0840-7cc6-4c47-a3d9-1cf135d01612 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.575129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bbd0840-7cc6-4c47-a3d9-1cf135d01612 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.575568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bbd0840-7cc6-4c47-a3d9-1cf135d01612 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.593440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-25e2d1fd-6009-49cb-9a94-a93419c85b34 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:17.594043 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-25e2d1fd-6009-49cb-9a94-a93419c85b34 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:17.599929 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25e2d1fd-6009-49cb-9a94-a93419c85b34 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.600404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25e2d1fd-6009-49cb-9a94-a93419c85b34 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.601215 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25e2d1fd-6009-49cb-9a94-a93419c85b34 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.601642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25e2d1fd-6009-49cb-9a94-a93419c85b34 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.703356 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1bbd0840-7cc6-4c47-a3d9-1cf135d01612 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:17.711655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1bbd0840-7cc6-4c47-a3d9-1cf135d01612 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.148775 Aug 01 14:11:17.712531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 200/408] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:17 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:17.732268 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-25e2d1fd-6009-49cb-9a94-a93419c85b34 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:17.740058 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-25e2d1fd-6009-49cb-9a94-a93419c85b34 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.150398 Aug 01 14:11:17.740639 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 209/409] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:17 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:17.824610 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5b50a7f7-ed6f-449a-bcaf-cb7314db766f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:17.825252 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5b50a7f7-ed6f-449a-bcaf-cb7314db766f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:17.831297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b50a7f7-ed6f-449a-bcaf-cb7314db766f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.831743 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b50a7f7-ed6f-449a-bcaf-cb7314db766f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.832522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b50a7f7-ed6f-449a-bcaf-cb7314db766f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:17.832961 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b50a7f7-ed6f-449a-bcaf-cb7314db766f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:17.968070 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5b50a7f7-ed6f-449a-bcaf-cb7314db766f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:17.976026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5b50a7f7-ed6f-449a-bcaf-cb7314db766f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.155378 Aug 01 14:11:17.976616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 201/410] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:17 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:18.149814 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ff4777b8-7575-4595-be97-b513360180c1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:18.150430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ff4777b8-7575-4595-be97-b513360180c1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:18.159499 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ff4777b8-7575-4595-be97-b513360180c1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:18.160252 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ff4777b8-7575-4595-be97-b513360180c1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.162260 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ff4777b8-7575-4595-be97-b513360180c1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:18.163023 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ff4777b8-7575-4595-be97-b513360180c1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.292825 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ff4777b8-7575-4595-be97-b513360180c1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:18.300784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ff4777b8-7575-4595-be97-b513360180c1 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.154817 Aug 01 14:11:18.301354 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 210/411] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:18 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:18.733573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7497fcaf-066e-4b68-9725-8e6075f2b2fa tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:18.734182 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7497fcaf-066e-4b68-9725-8e6075f2b2fa tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:18.740133 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7497fcaf-066e-4b68-9725-8e6075f2b2fa tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:18.740625 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7497fcaf-066e-4b68-9725-8e6075f2b2fa tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.741370 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7497fcaf-066e-4b68-9725-8e6075f2b2fa tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:18.741799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7497fcaf-066e-4b68-9725-8e6075f2b2fa tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.761151 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fba10718-49ed-45e9-a6f2-120dd6a62c0a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:18.761766 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fba10718-49ed-45e9-a6f2-120dd6a62c0a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:18.768243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fba10718-49ed-45e9-a6f2-120dd6a62c0a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:18.768709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fba10718-49ed-45e9-a6f2-120dd6a62c0a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.769476 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fba10718-49ed-45e9-a6f2-120dd6a62c0a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:18.769912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fba10718-49ed-45e9-a6f2-120dd6a62c0a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:18.869477 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7497fcaf-066e-4b68-9725-8e6075f2b2fa tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:18.877683 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7497fcaf-066e-4b68-9725-8e6075f2b2fa tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.147786 Aug 01 14:11:18.878318 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 202/412] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:18 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:18.906546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fba10718-49ed-45e9-a6f2-120dd6a62c0a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:18.914147 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fba10718-49ed-45e9-a6f2-120dd6a62c0a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.156770 Aug 01 14:11:18.914715 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 211/413] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:18 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:18.997693 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e72989da-63a2-4b57-aa77-0817afb1d6a0 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:18.998237 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e72989da-63a2-4b57-aa77-0817afb1d6a0 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:19.004747 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e72989da-63a2-4b57-aa77-0817afb1d6a0 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.005207 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e72989da-63a2-4b57-aa77-0817afb1d6a0 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.005974 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e72989da-63a2-4b57-aa77-0817afb1d6a0 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.006413 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e72989da-63a2-4b57-aa77-0817afb1d6a0 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.135513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e72989da-63a2-4b57-aa77-0817afb1d6a0 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:19.143085 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e72989da-63a2-4b57-aa77-0817afb1d6a0 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.149335 Aug 01 14:11:19.143657 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 203/414] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:18 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:19.322393 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c57507d8-131a-4136-9a0e-8974e808c6c4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:19.322920 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c57507d8-131a-4136-9a0e-8974e808c6c4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:19.331357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c57507d8-131a-4136-9a0e-8974e808c6c4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.331808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c57507d8-131a-4136-9a0e-8974e808c6c4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.332668 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c57507d8-131a-4136-9a0e-8974e808c6c4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.333055 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c57507d8-131a-4136-9a0e-8974e808c6c4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.460620 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c57507d8-131a-4136-9a0e-8974e808c6c4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:19.468375 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c57507d8-131a-4136-9a0e-8974e808c6c4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.151128 Aug 01 14:11:19.469477 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 212/415] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:19 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:19.898634 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dac09a89-0074-437c-b19d-28bb96bcc205 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:19.899266 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dac09a89-0074-437c-b19d-28bb96bcc205 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:19.905307 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dac09a89-0074-437c-b19d-28bb96bcc205 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.905761 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dac09a89-0074-437c-b19d-28bb96bcc205 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.906533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dac09a89-0074-437c-b19d-28bb96bcc205 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.906969 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dac09a89-0074-437c-b19d-28bb96bcc205 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.911038 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:19.934817 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-92d9bedf-859c-4b6d-9db8-aa8c198ab4a0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:19.935429 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-92d9bedf-859c-4b6d-9db8-aa8c198ab4a0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:19.937431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=92 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:19.943409 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92d9bedf-859c-4b6d-9db8-aa8c198ab4a0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.943854 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92d9bedf-859c-4b6d-9db8-aa8c198ab4a0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:19.944675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92d9bedf-859c-4b6d-9db8-aa8c198ab4a0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:19.945108 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92d9bedf-859c-4b6d-9db8-aa8c198ab4a0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:20.036956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dac09a89-0074-437c-b19d-28bb96bcc205 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:20.044230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dac09a89-0074-437c-b19d-28bb96bcc205 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.149498 Aug 01 14:11:20.044824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 204/416] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:19 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:20.078826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-92d9bedf-859c-4b6d-9db8-aa8c198ab4a0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:20.086232 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-92d9bedf-859c-4b6d-9db8-aa8c198ab4a0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.155187 Aug 01 14:11:20.086803 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 213/417] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:19 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:20.163795 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cce52006-d2ef-475d-8cc6-89532a6d2255 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:20.164417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cce52006-d2ef-475d-8cc6-89532a6d2255 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:20.170420 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cce52006-d2ef-475d-8cc6-89532a6d2255 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:20.170868 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cce52006-d2ef-475d-8cc6-89532a6d2255 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:20.171634 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cce52006-d2ef-475d-8cc6-89532a6d2255 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:20.172728 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cce52006-d2ef-475d-8cc6-89532a6d2255 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:20.302114 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cce52006-d2ef-475d-8cc6-89532a6d2255 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:20.309537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cce52006-d2ef-475d-8cc6-89532a6d2255 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.149507 Aug 01 14:11:20.310102 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 205/418] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:20 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:20.490227 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2ab43314-7808-4cc1-80a8-1f32be0a9360 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:20.490832 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2ab43314-7808-4cc1-80a8-1f32be0a9360 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:20.497283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2ab43314-7808-4cc1-80a8-1f32be0a9360 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:20.497722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2ab43314-7808-4cc1-80a8-1f32be0a9360 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:20.498472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2ab43314-7808-4cc1-80a8-1f32be0a9360 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:20.498929 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2ab43314-7808-4cc1-80a8-1f32be0a9360 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:20.516847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:20.626059 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2ab43314-7808-4cc1-80a8-1f32be0a9360 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:20.634910 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2ab43314-7808-4cc1-80a8-1f32be0a9360 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.148530 Aug 01 14:11:20.635483 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 214/419] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:20 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:21.065784 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9bac730a-3410-4f4b-b8de-c2992065311e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:21.066385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9bac730a-3410-4f4b-b8de-c2992065311e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:21.072311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bac730a-3410-4f4b-b8de-c2992065311e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.072793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bac730a-3410-4f4b-b8de-c2992065311e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.073542 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bac730a-3410-4f4b-b8de-c2992065311e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.073972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9bac730a-3410-4f4b-b8de-c2992065311e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.107473 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7634dc1d-1091-4713-a3bd-55320acadf3a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:21.108269 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7634dc1d-1091-4713-a3bd-55320acadf3a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:21.114808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7634dc1d-1091-4713-a3bd-55320acadf3a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.115256 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7634dc1d-1091-4713-a3bd-55320acadf3a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.116038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7634dc1d-1091-4713-a3bd-55320acadf3a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.116500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7634dc1d-1091-4713-a3bd-55320acadf3a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.315290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7634dc1d-1091-4713-a3bd-55320acadf3a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:21.323630 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7634dc1d-1091-4713-a3bd-55320acadf3a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1356 microversion: 2.1 time: 0.220170 Aug 01 14:11:21.336811 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 215/420] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:21 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1356 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:21.342297 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-641c10fe-d2c8-4ff2-ab5f-c0be2d8a4981 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:21.343094 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-641c10fe-d2c8-4ff2-ab5f-c0be2d8a4981 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:21.350168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-641c10fe-d2c8-4ff2-ab5f-c0be2d8a4981 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.350728 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-641c10fe-d2c8-4ff2-ab5f-c0be2d8a4981 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.351574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-641c10fe-d2c8-4ff2-ab5f-c0be2d8a4981 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.352084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-641c10fe-d2c8-4ff2-ab5f-c0be2d8a4981 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.413676 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9bac730a-3410-4f4b-b8de-c2992065311e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:21.423322 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9bac730a-3410-4f4b-b8de-c2992065311e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.361684 Aug 01 14:11:21.430546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 206/421] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:21 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:21.572196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-641c10fe-d2c8-4ff2-ab5f-c0be2d8a4981 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:21.579653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-641c10fe-d2c8-4ff2-ab5f-c0be2d8a4981 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.241891 Aug 01 14:11:21.580215 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 216/422] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:21 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:21.657004 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f475d1ec-d938-428e-aa6b-2fc1b3ad4dbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:21.657922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f475d1ec-d938-428e-aa6b-2fc1b3ad4dbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:21.659797 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:21.660688 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:21.667026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f475d1ec-d938-428e-aa6b-2fc1b3ad4dbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.667480 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f475d1ec-d938-428e-aa6b-2fc1b3ad4dbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.668254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f475d1ec-d938-428e-aa6b-2fc1b3ad4dbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:21.668719 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f475d1ec-d938-428e-aa6b-2fc1b3ad4dbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:21.799744 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f475d1ec-d938-428e-aa6b-2fc1b3ad4dbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:21.807247 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f475d1ec-d938-428e-aa6b-2fc1b3ad4dbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.154785 Aug 01 14:11:21.807810 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 207/423] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:21 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:22.347535 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d6765e85-48e5-44b5-b39d-5712726ce02a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.348065 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d6765e85-48e5-44b5-b39d-5712726ce02a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:22.350045 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:22.357121 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d6765e85-48e5-44b5-b39d-5712726ce02a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.357576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d6765e85-48e5-44b5-b39d-5712726ce02a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.358361 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d6765e85-48e5-44b5-b39d-5712726ce02a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.358885 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d6765e85-48e5-44b5-b39d-5712726ce02a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.444147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-520dc518-26e1-4a66-bb45-9a025be3d9f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.444916 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-520dc518-26e1-4a66-bb45-9a025be3d9f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:22.452643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520dc518-26e1-4a66-bb45-9a025be3d9f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.453970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520dc518-26e1-4a66-bb45-9a025be3d9f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.454783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520dc518-26e1-4a66-bb45-9a025be3d9f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.455243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-520dc518-26e1-4a66-bb45-9a025be3d9f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.611648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d6765e85-48e5-44b5-b39d-5712726ce02a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:22.625997 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d6765e85-48e5-44b5-b39d-5712726ce02a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1547 microversion: 2.1 time: 0.282979 Aug 01 14:11:22.628215 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 217/424] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1547 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:22.634624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0a11769a-41d5-456c-abfe-0797720ecc9e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.635958 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0a11769a-41d5-456c-abfe-0797720ecc9e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:22.646427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0a11769a-41d5-456c-abfe-0797720ecc9e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.647117 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0a11769a-41d5-456c-abfe-0797720ecc9e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.648900 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0a11769a-41d5-456c-abfe-0797720ecc9e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.650100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0a11769a-41d5-456c-abfe-0797720ecc9e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.685502 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-520dc518-26e1-4a66-bb45-9a025be3d9f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:22.694933 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-520dc518-26e1-4a66-bb45-9a025be3d9f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.254716 Aug 01 14:11:22.695609 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 208/425] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:22.715081 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-98be4ede-f336-45d8-a8df-3006926714c3 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.716445 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-98be4ede-f336-45d8-a8df-3006926714c3 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:22.723417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98be4ede-f336-45d8-a8df-3006926714c3 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.723865 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98be4ede-f336-45d8-a8df-3006926714c3 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.724697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98be4ede-f336-45d8-a8df-3006926714c3 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.725135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98be4ede-f336-45d8-a8df-3006926714c3 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.843724 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0a11769a-41d5-456c-abfe-0797720ecc9e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:22.852753 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0a11769a-41d5-456c-abfe-0797720ecc9e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.223224 Aug 01 14:11:22.853336 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 218/426] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:22.858022 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6ff25e51-5efa-414f-8977-08e6ade36be0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.858569 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6ff25e51-5efa-414f-8977-08e6ade36be0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:22.865065 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6ff25e51-5efa-414f-8977-08e6ade36be0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.865509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6ff25e51-5efa-414f-8977-08e6ade36be0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.866335 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6ff25e51-5efa-414f-8977-08e6ade36be0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.866775 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6ff25e51-5efa-414f-8977-08e6ade36be0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.909378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-98be4ede-f336-45d8-a8df-3006926714c3 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:22.916947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-98be4ede-f336-45d8-a8df-3006926714c3 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1547 microversion: 2.1 time: 0.207107 Aug 01 14:11:22.917561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 209/427] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1547 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:22.937823 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:22.942581 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:22.943347 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Searching by: {'deleted': False, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e'} {{(pid=117859) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 01 14:11:22.950090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.950535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.951331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:22.951762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:22.996882 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6ff25e51-5efa-414f-8977-08e6ade36be0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:23.004696 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6ff25e51-5efa-414f-8977-08e6ade36be0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.150185 Aug 01 14:11:23.005365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 219/428] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:23.041437 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.multi_cell_list [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117859) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 01 14:11:23.131242 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-17f379a0-6c0c-4a66-9a29-d737102560bd tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.197628 Aug 01 14:11:23.131739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 210/429] 10.222.0.48 () {58 vars in 1125 bytes} [Mon Aug 1 14:11:22 2022] GET /compute/v2.1/servers => generated 341 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:23.143739 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9b42db03-0cab-428e-a32f-8f06d7b87746 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:23.144393 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9b42db03-0cab-428e-a32f-8f06d7b87746 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:23.150373 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9b42db03-0cab-428e-a32f-8f06d7b87746 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:23.150821 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9b42db03-0cab-428e-a32f-8f06d7b87746 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:23.151585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9b42db03-0cab-428e-a32f-8f06d7b87746 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:23.152023 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9b42db03-0cab-428e-a32f-8f06d7b87746 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:23.281544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9b42db03-0cab-428e-a32f-8f06d7b87746 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:23.289213 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9b42db03-0cab-428e-a32f-8f06d7b87746 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1547 microversion: 2.1 time: 0.149843 Aug 01 14:11:23.289781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 220/430] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:23 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:23.717056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1ecf4d14-bf50-447c-9652-2ca90b816f30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:23.717658 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1ecf4d14-bf50-447c-9652-2ca90b816f30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:23.723662 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ecf4d14-bf50-447c-9652-2ca90b816f30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:23.724103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ecf4d14-bf50-447c-9652-2ca90b816f30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:23.724887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ecf4d14-bf50-447c-9652-2ca90b816f30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:23.725313 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ecf4d14-bf50-447c-9652-2ca90b816f30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:23.852548 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1ecf4d14-bf50-447c-9652-2ca90b816f30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:23.860577 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1ecf4d14-bf50-447c-9652-2ca90b816f30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.147718 Aug 01 14:11:23.861143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 211/431] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:23 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:23.875704 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-43a36d23-c5ec-46a1-ac0f-df91f3a23910 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:23.876319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-43a36d23-c5ec-46a1-ac0f-df91f3a23910 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:23.883083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43a36d23-c5ec-46a1-ac0f-df91f3a23910 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:23.883613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43a36d23-c5ec-46a1-ac0f-df91f3a23910 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:23.884474 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43a36d23-c5ec-46a1-ac0f-df91f3a23910 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:23.884943 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43a36d23-c5ec-46a1-ac0f-df91f3a23910 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.014852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-43a36d23-c5ec-46a1-ac0f-df91f3a23910 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:24.022349 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-43a36d23-c5ec-46a1-ac0f-df91f3a23910 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.151195 Aug 01 14:11:24.022934 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 221/432] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:23 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:24.025942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-24633aaf-e148-4926-8faa-3aeee269f9e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:24.026558 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-24633aaf-e148-4926-8faa-3aeee269f9e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:24.033135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24633aaf-e148-4926-8faa-3aeee269f9e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.033582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24633aaf-e148-4926-8faa-3aeee269f9e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.034349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24633aaf-e148-4926-8faa-3aeee269f9e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.034792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24633aaf-e148-4926-8faa-3aeee269f9e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.169111 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-24633aaf-e148-4926-8faa-3aeee269f9e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:24.177173 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-24633aaf-e148-4926-8faa-3aeee269f9e5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.155069 Aug 01 14:11:24.177739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 212/433] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:24 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:24.849879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f2b5375b-9d20-4c58-b83f-741f39bdb9a6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "04622d17-5bd4-4c9e-bdde-92194c25b009"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:24.852454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f2b5375b-9d20-4c58-b83f-741f39bdb9a6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:24.858624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f2b5375b-9d20-4c58-b83f-741f39bdb9a6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.859066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f2b5375b-9d20-4c58-b83f-741f39bdb9a6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.859823 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f2b5375b-9d20-4c58-b83f-741f39bdb9a6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.860249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f2b5375b-9d20-4c58-b83f-741f39bdb9a6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.881952 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ecbfa463-b8a0-4eb1-b7e7-460bffa985e9 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:24.882558 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ecbfa463-b8a0-4eb1-b7e7-460bffa985e9 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:24.888782 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ecbfa463-b8a0-4eb1-b7e7-460bffa985e9 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.889250 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ecbfa463-b8a0-4eb1-b7e7-460bffa985e9 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:24.890746 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ecbfa463-b8a0-4eb1-b7e7-460bffa985e9 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:24.891368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ecbfa463-b8a0-4eb1-b7e7-460bffa985e9 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.025037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ecbfa463-b8a0-4eb1-b7e7-460bffa985e9 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:25.032365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ecbfa463-b8a0-4eb1-b7e7-460bffa985e9 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.154757 Aug 01 14:11:25.032963 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 213/434] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:24 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:25.042642 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-680ac4f8-f517-44af-8bcc-4b85c07cba5b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:25.043245 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-680ac4f8-f517-44af-8bcc-4b85c07cba5b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:25.049437 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-680ac4f8-f517-44af-8bcc-4b85c07cba5b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.049881 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-680ac4f8-f517-44af-8bcc-4b85c07cba5b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.050634 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-680ac4f8-f517-44af-8bcc-4b85c07cba5b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.051065 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-680ac4f8-f517-44af-8bcc-4b85c07cba5b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.187925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-680ac4f8-f517-44af-8bcc-4b85c07cba5b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:25.195356 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-680ac4f8-f517-44af-8bcc-4b85c07cba5b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.156222 Aug 01 14:11:25.195918 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 214/435] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:25 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:25.200238 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6bcb0547-8b02-4872-8cc1-48b04a33edf5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:25.200868 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6bcb0547-8b02-4872-8cc1-48b04a33edf5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:25.206482 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6bcb0547-8b02-4872-8cc1-48b04a33edf5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.206941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6bcb0547-8b02-4872-8cc1-48b04a33edf5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.207697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6bcb0547-8b02-4872-8cc1-48b04a33edf5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:25.208131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6bcb0547-8b02-4872-8cc1-48b04a33edf5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:25.336019 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6bcb0547-8b02-4872-8cc1-48b04a33edf5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:25.344236 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6bcb0547-8b02-4872-8cc1-48b04a33edf5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.147390 Aug 01 14:11:25.344823 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 215/436] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:25 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:26.053266 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b77538f2-4aa2-4171-a034-9c871755b346 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:26.053874 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b77538f2-4aa2-4171-a034-9c871755b346 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:26.059876 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b77538f2-4aa2-4171-a034-9c871755b346 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.060326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b77538f2-4aa2-4171-a034-9c871755b346 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.061125 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b77538f2-4aa2-4171-a034-9c871755b346 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.061561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b77538f2-4aa2-4171-a034-9c871755b346 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.187462 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b77538f2-4aa2-4171-a034-9c871755b346 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:26.194783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b77538f2-4aa2-4171-a034-9c871755b346 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.145369 Aug 01 14:11:26.195347 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 216/437] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:26 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:26.215794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6cd4e177-1fcb-4bd5-9b00-73392e6e846f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:26.216427 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6cd4e177-1fcb-4bd5-9b00-73392e6e846f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:26.222593 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cd4e177-1fcb-4bd5-9b00-73392e6e846f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.223040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cd4e177-1fcb-4bd5-9b00-73392e6e846f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.223794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cd4e177-1fcb-4bd5-9b00-73392e6e846f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.224300 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cd4e177-1fcb-4bd5-9b00-73392e6e846f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.353426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6cd4e177-1fcb-4bd5-9b00-73392e6e846f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:26.361851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6cd4e177-1fcb-4bd5-9b00-73392e6e846f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.149761 Aug 01 14:11:26.362408 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 217/438] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:26 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:26.366817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-34e624dd-289f-4843-8c74-2b83e95da0bb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:26.367411 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-34e624dd-289f-4843-8c74-2b83e95da0bb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:26.373384 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34e624dd-289f-4843-8c74-2b83e95da0bb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.373832 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34e624dd-289f-4843-8c74-2b83e95da0bb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.374641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34e624dd-289f-4843-8c74-2b83e95da0bb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:26.375075 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34e624dd-289f-4843-8c74-2b83e95da0bb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:26.501644 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-34e624dd-289f-4843-8c74-2b83e95da0bb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:26.509071 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-34e624dd-289f-4843-8c74-2b83e95da0bb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.145680 Aug 01 14:11:26.509716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 218/439] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:26 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:27.215659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6dbb4845-b6c9-4b58-9f61-bf123495d6d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:27.216412 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6dbb4845-b6c9-4b58-9f61-bf123495d6d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:27.223945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6dbb4845-b6c9-4b58-9f61-bf123495d6d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:27.224473 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6dbb4845-b6c9-4b58-9f61-bf123495d6d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.225446 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6dbb4845-b6c9-4b58-9f61-bf123495d6d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:27.225923 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6dbb4845-b6c9-4b58-9f61-bf123495d6d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.368860 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6dbb4845-b6c9-4b58-9f61-bf123495d6d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:27.376594 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6dbb4845-b6c9-4b58-9f61-bf123495d6d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.165141 Aug 01 14:11:27.377359 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 219/440] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:27 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:27.382165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4773e04c-c752-4fd3-bf1b-60799f4124a4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:27.382764 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4773e04c-c752-4fd3-bf1b-60799f4124a4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:27.388762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4773e04c-c752-4fd3-bf1b-60799f4124a4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:27.389270 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4773e04c-c752-4fd3-bf1b-60799f4124a4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.390475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4773e04c-c752-4fd3-bf1b-60799f4124a4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:27.390908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4773e04c-c752-4fd3-bf1b-60799f4124a4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.414115 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:27.525962 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4773e04c-c752-4fd3-bf1b-60799f4124a4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:27.537234 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4773e04c-c752-4fd3-bf1b-60799f4124a4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.158474 Aug 01 14:11:27.538031 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 220/441] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:27 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:27.542455 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d83488b3-150b-477f-8820-977c6e1e9561 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:27.543052 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d83488b3-150b-477f-8820-977c6e1e9561 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:27.548967 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d83488b3-150b-477f-8820-977c6e1e9561 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:27.549405 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d83488b3-150b-477f-8820-977c6e1e9561 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.550194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d83488b3-150b-477f-8820-977c6e1e9561 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:27.550859 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d83488b3-150b-477f-8820-977c6e1e9561 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:27.692563 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d83488b3-150b-477f-8820-977c6e1e9561 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:27.700979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d83488b3-150b-477f-8820-977c6e1e9561 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.162104 Aug 01 14:11:27.701752 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 221/442] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:27 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:28.350971 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f2b5375b-9d20-4c58-b83f-741f39bdb9a6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "POST /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.505042 Aug 01 14:11:28.352282 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 222/443] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:11:24 2022] POST /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments => generated 194 bytes in 3507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:28.398902 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4381198d-6fe6-4348-8f6b-f31b5e28afe5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:28.400106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4381198d-6fe6-4348-8f6b-f31b5e28afe5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:28.411304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4381198d-6fe6-4348-8f6b-f31b5e28afe5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.412216 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4381198d-6fe6-4348-8f6b-f31b5e28afe5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.413486 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4381198d-6fe6-4348-8f6b-f31b5e28afe5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.414197 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4381198d-6fe6-4348-8f6b-f31b5e28afe5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.559186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fd8cea68-cefa-4525-8cce-6019c458bfd8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:28.560073 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fd8cea68-cefa-4525-8cce-6019c458bfd8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:28.566912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd8cea68-cefa-4525-8cce-6019c458bfd8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.567373 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd8cea68-cefa-4525-8cce-6019c458bfd8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.568589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd8cea68-cefa-4525-8cce-6019c458bfd8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.569029 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd8cea68-cefa-4525-8cce-6019c458bfd8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.621789 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4381198d-6fe6-4348-8f6b-f31b5e28afe5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:28.630925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4381198d-6fe6-4348-8f6b-f31b5e28afe5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.236199 Aug 01 14:11:28.632527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 222/444] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:28 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:28.706133 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fd8cea68-cefa-4525-8cce-6019c458bfd8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:28.713821 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fd8cea68-cefa-4525-8cce-6019c458bfd8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.159547 Aug 01 14:11:28.714391 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 223/445] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:28 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:28.724649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c4f7318f-2ad5-4f2e-b19e-8988da2b6771 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:28.724649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c4f7318f-2ad5-4f2e-b19e-8988da2b6771 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:28.737343 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c4f7318f-2ad5-4f2e-b19e-8988da2b6771 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.737875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c4f7318f-2ad5-4f2e-b19e-8988da2b6771 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.739828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c4f7318f-2ad5-4f2e-b19e-8988da2b6771 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:28.740618 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c4f7318f-2ad5-4f2e-b19e-8988da2b6771 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:28.908967 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c4f7318f-2ad5-4f2e-b19e-8988da2b6771 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:28.916828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c4f7318f-2ad5-4f2e-b19e-8988da2b6771 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.198052 Aug 01 14:11:28.917640 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 223/446] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:28 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:29.139976 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-2270ab1c-7fd4-4d5d-8c32-0e1c41d85d69 req-6ac4beb4-0b51-4132-8e7d-f35845f6640a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5922be0-946e-4dff-b598-80a7ff1433d3", "name": "network-vif-plugged", "status": "completed", "tag": "20f75126-d096-4a15-ba80-92b6596dcd7c"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:29.151588 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-2270ab1c-7fd4-4d5d-8c32-0e1c41d85d69 req-6ac4beb4-0b51-4132-8e7d-f35845f6640a service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.152241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-2270ab1c-7fd4-4d5d-8c32-0e1c41d85d69 req-6ac4beb4-0b51-4132-8e7d-f35845f6640a service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.164514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-2270ab1c-7fd4-4d5d-8c32-0e1c41d85d69 req-6ac4beb4-0b51-4132-8e7d-f35845f6640a service nova] Creating event network-vif-plugged:20f75126-d096-4a15-ba80-92b6596dcd7c for instance f5922be0-946e-4dff-b598-80a7ff1433d3 on hv-cinder-84713 Aug 01 14:11:29.170761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-2270ab1c-7fd4-4d5d-8c32-0e1c41d85d69 req-6ac4beb4-0b51-4132-8e7d-f35845f6640a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034627 Aug 01 14:11:29.172030 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 224/447] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:29.652242 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3620bd0c-f638-40cf-9e58-12170fcc0a5c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:29.653914 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3620bd0c-f638-40cf-9e58-12170fcc0a5c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:29.661468 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3620bd0c-f638-40cf-9e58-12170fcc0a5c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.663200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3620bd0c-f638-40cf-9e58-12170fcc0a5c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.664883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3620bd0c-f638-40cf-9e58-12170fcc0a5c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.665402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3620bd0c-f638-40cf-9e58-12170fcc0a5c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.740059 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3483c439-92e9-4f7c-a8ba-10e76dfca7da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:29.740899 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3483c439-92e9-4f7c-a8ba-10e76dfca7da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:29.749021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3483c439-92e9-4f7c-a8ba-10e76dfca7da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.749794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3483c439-92e9-4f7c-a8ba-10e76dfca7da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.750770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3483c439-92e9-4f7c-a8ba-10e76dfca7da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.751879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3483c439-92e9-4f7c-a8ba-10e76dfca7da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.836380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3620bd0c-f638-40cf-9e58-12170fcc0a5c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:29.845220 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3620bd0c-f638-40cf-9e58-12170fcc0a5c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.197493 Aug 01 14:11:29.849301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 224/448] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:29 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:29.939280 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8f550840-9eed-4017-a940-7be81de70307 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:29.939863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8f550840-9eed-4017-a940-7be81de70307 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:29.946024 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8f550840-9eed-4017-a940-7be81de70307 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.946506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8f550840-9eed-4017-a940-7be81de70307 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:29.947282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8f550840-9eed-4017-a940-7be81de70307 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:29.947715 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8f550840-9eed-4017-a940-7be81de70307 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:30.053907 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3483c439-92e9-4f7c-a8ba-10e76dfca7da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:30.062132 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3483c439-92e9-4f7c-a8ba-10e76dfca7da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.327017 Aug 01 14:11:30.063366 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 225/449] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:29 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:30.094785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8f550840-9eed-4017-a940-7be81de70307 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:30.102476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8f550840-9eed-4017-a940-7be81de70307 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.167749 Aug 01 14:11:30.103083 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 225/450] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:29 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:30.865943 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f4cb8ab1-62c9-421f-be48-87bf9a6d4003 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:30.866890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f4cb8ab1-62c9-421f-be48-87bf9a6d4003 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:30.873946 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f4cb8ab1-62c9-421f-be48-87bf9a6d4003 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:30.874550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f4cb8ab1-62c9-421f-be48-87bf9a6d4003 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:30.875462 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f4cb8ab1-62c9-421f-be48-87bf9a6d4003 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:30.876006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f4cb8ab1-62c9-421f-be48-87bf9a6d4003 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.084267 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5e38a024-8329-4755-8bcd-5aa20ca1bd30 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:31.084908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5e38a024-8329-4755-8bcd-5aa20ca1bd30 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:31.091979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e38a024-8329-4755-8bcd-5aa20ca1bd30 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.092433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e38a024-8329-4755-8bcd-5aa20ca1bd30 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.094158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e38a024-8329-4755-8bcd-5aa20ca1bd30 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.094596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e38a024-8329-4755-8bcd-5aa20ca1bd30 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.210410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f4cb8ab1-62c9-421f-be48-87bf9a6d4003 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:31.238970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f4cb8ab1-62c9-421f-be48-87bf9a6d4003 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.372611 Aug 01 14:11:31.252513 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 226/451] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:30 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:31.252824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5e38a024-8329-4755-8bcd-5aa20ca1bd30 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:31.255189 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7a4f7d4e-6a4a-4d68-a9e5-50a50f2feee0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:31.256466 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7a4f7d4e-6a4a-4d68-a9e5-50a50f2feee0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:31.258367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5e38a024-8329-4755-8bcd-5aa20ca1bd30 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.178206 Aug 01 14:11:31.259013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 226/452] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:31 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:31.270184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7a4f7d4e-6a4a-4d68-a9e5-50a50f2feee0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.270773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7a4f7d4e-6a4a-4d68-a9e5-50a50f2feee0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.271777 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7a4f7d4e-6a4a-4d68-a9e5-50a50f2feee0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:31.272420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7a4f7d4e-6a4a-4d68-a9e5-50a50f2feee0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:31.501127 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7a4f7d4e-6a4a-4d68-a9e5-50a50f2feee0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:31.510171 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7a4f7d4e-6a4a-4d68-a9e5-50a50f2feee0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.267877 Aug 01 14:11:31.510961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 227/453] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:31 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:32.264043 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4def0925-5b73-4136-931c-b9d790f3b74d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:32.265388 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4def0925-5b73-4136-931c-b9d790f3b74d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.271553 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4def0925-5b73-4136-931c-b9d790f3b74d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.272069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4def0925-5b73-4136-931c-b9d790f3b74d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.273896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4def0925-5b73-4136-931c-b9d790f3b74d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.273896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4def0925-5b73-4136-931c-b9d790f3b74d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.279025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a429e551-62c2-49e0-9ffa-ea314d20d036 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:32.279631 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a429e551-62c2-49e0-9ffa-ea314d20d036 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.291139 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a429e551-62c2-49e0-9ffa-ea314d20d036 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.292299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a429e551-62c2-49e0-9ffa-ea314d20d036 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.293884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a429e551-62c2-49e0-9ffa-ea314d20d036 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.294473 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a429e551-62c2-49e0-9ffa-ea314d20d036 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.515577 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4def0925-5b73-4136-931c-b9d790f3b74d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:32.534079 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4def0925-5b73-4136-931c-b9d790f3b74d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.274403 Aug 01 14:11:32.534819 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 227/454] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:32 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:32.543890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b69b67e5-4324-462d-9d06-8aef90a80890 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:32.544299 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b69b67e5-4324-462d-9d06-8aef90a80890 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.552797 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b69b67e5-4324-462d-9d06-8aef90a80890 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.553512 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b69b67e5-4324-462d-9d06-8aef90a80890 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.554466 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b69b67e5-4324-462d-9d06-8aef90a80890 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.555062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b69b67e5-4324-462d-9d06-8aef90a80890 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.667858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a429e551-62c2-49e0-9ffa-ea314d20d036 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:32.685023 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a429e551-62c2-49e0-9ffa-ea314d20d036 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1318 microversion: 2.1 time: 0.409612 Aug 01 14:11:32.686937 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 228/455] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:32 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:32.738031 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b69b67e5-4324-462d-9d06-8aef90a80890 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:32.748279 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b69b67e5-4324-462d-9d06-8aef90a80890 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1502 microversion: 2.1 time: 0.211819 Aug 01 14:11:32.750159 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 228/456] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:32 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1502 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:32.775119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cf815f6-f02f-4a49-955d-7d504d3ec906"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:32.777566 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.784054 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.785154 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.786218 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.786728 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.816642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] HTTP exception thrown: Cannot 'attach_volume' instance e8fa6e78-136c-4153-a57c-926647075a19 while it is in vm_state rescued Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Request method failure captured: Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: POST /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19/os-volume_attachments HTTP/1.1 Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 74 Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_QTP34zCqxkjuzGhNGLJjTdwR4Wdl9YtCoqvRiTXZc35VR0PDFWWOlwBCKUJQGjaghsULTBWYIDh0BETy4ucBH_XjPQZxYfXn1Z8Rmv0h464Jj2L3NqHAUmDGP6rXRjuKMfTyHWkpaKimc-w1uebscESmboyRMBjkIwxCdpVdxS0 Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:11:32.818740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}] Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: f379b005418a4e399c3b72cbbef6e00d Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {"volumeAttachment": {"volumeId": "0cf815f6-f02f-4a49-955d-7d504d3ec906"}} Aug 01 14:11:32.820109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Cannot 'attach_volume' instance e8fa6e78-136c-4153-a57c-926647075a19 while it is in vm_state rescued Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'server_id': 'e8fa6e78-136c-4153-a57c-926647075a19', 'body': {'volumeAttachment': {'volumeId': '0cf815f6-f02f-4a49-955d-7d504d3ec906'}}} Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e8fa6e78-136c-4153-a57c-926647075a19 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:11:32.822990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e8fa6e78-136c-4153-a57c-926647075a19 while it is in vm_state rescued Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:11:32.824290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:11:32.825488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:11:32.825488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:11:32.825488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e8fa6e78-136c-4153-a57c-926647075a19 while it is in vm_state rescued Aug 01 14:11:32.825488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:11:32.825488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Returning 409 to user: Cannot 'attach_volume' instance e8fa6e78-136c-4153-a57c-926647075a19 while it is in vm_state rescued {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:11:32.825488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0b536ffc-72aa-49c2-8a4f-3ae21ddfbd60 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.050610 Aug 01 14:11:32.825488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 229/457] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:11:32 2022] POST /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19/os-volume_attachments => generated 152 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 01 14:11:32.830986 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-28bc87e1-198d-4b69-ab16-d5c0ffc52a0d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:32.832087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-28bc87e1-198d-4b69-ab16-d5c0ffc52a0d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.839874 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28bc87e1-198d-4b69-ab16-d5c0ffc52a0d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.840328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28bc87e1-198d-4b69-ab16-d5c0ffc52a0d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.841132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28bc87e1-198d-4b69-ab16-d5c0ffc52a0d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.841568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28bc87e1-198d-4b69-ab16-d5c0ffc52a0d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.925478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-28bc87e1-198d-4b69-ab16-d5c0ffc52a0d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19/action" status: 202 len: 0 microversion: 2.1 time: 0.099146 Aug 01 14:11:32.928522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 229/458] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:11:32 2022] POST /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:11:32.934377 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-14711332-da20-42fd-aa48-69467fbc45d9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:32.935081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-14711332-da20-42fd-aa48-69467fbc45d9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:32.941855 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14711332-da20-42fd-aa48-69467fbc45d9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.942326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14711332-da20-42fd-aa48-69467fbc45d9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:32.943104 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14711332-da20-42fd-aa48-69467fbc45d9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:32.943545 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14711332-da20-42fd-aa48-69467fbc45d9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.118081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-14711332-da20-42fd-aa48-69467fbc45d9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:33.122845 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:33.137522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-14711332-da20-42fd-aa48-69467fbc45d9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1510 microversion: 2.1 time: 0.204556 Aug 01 14:11:33.155224 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 230/459] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:32 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1510 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:33.552974 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:33.558051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fca5f9c4-130b-46e6-aaaa-a364d00dc900 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:33.558760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fca5f9c4-130b-46e6-aaaa-a364d00dc900 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:33.566164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fca5f9c4-130b-46e6-aaaa-a364d00dc900 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:33.566847 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fca5f9c4-130b-46e6-aaaa-a364d00dc900 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.567819 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fca5f9c4-130b-46e6-aaaa-a364d00dc900 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:33.568474 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fca5f9c4-130b-46e6-aaaa-a364d00dc900 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.708442 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0141f8df-367e-477d-aee9-b4e989e9573b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:33.709159 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0141f8df-367e-477d-aee9-b4e989e9573b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:33.718483 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0141f8df-367e-477d-aee9-b4e989e9573b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:33.719170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0141f8df-367e-477d-aee9-b4e989e9573b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.720126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0141f8df-367e-477d-aee9-b4e989e9573b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:33.720632 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0141f8df-367e-477d-aee9-b4e989e9573b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:33.763076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fca5f9c4-130b-46e6-aaaa-a364d00dc900 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:33.794377 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fca5f9c4-130b-46e6-aaaa-a364d00dc900 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.234304 Aug 01 14:11:33.796334 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 230/460] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:33 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:33.994055 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0141f8df-367e-477d-aee9-b4e989e9573b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:34.014544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0141f8df-367e-477d-aee9-b4e989e9573b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1505 microversion: 2.1 time: 0.311523 Aug 01 14:11:34.015724 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 231/461] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:33 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:34.162320 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bcdff3f5-57ad-49f1-9096-46aa4d1cb3ab tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:34.166624 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bcdff3f5-57ad-49f1-9096-46aa4d1cb3ab tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:34.174428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bcdff3f5-57ad-49f1-9096-46aa4d1cb3ab tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:34.174882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bcdff3f5-57ad-49f1-9096-46aa4d1cb3ab tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:34.175675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bcdff3f5-57ad-49f1-9096-46aa4d1cb3ab tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:34.180245 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bcdff3f5-57ad-49f1-9096-46aa4d1cb3ab tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:34.726999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bcdff3f5-57ad-49f1-9096-46aa4d1cb3ab tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:34.740995 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bcdff3f5-57ad-49f1-9096-46aa4d1cb3ab tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1510 microversion: 2.1 time: 0.582860 Aug 01 14:11:34.772520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 231/462] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:34 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1510 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:34.826476 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7f67c944-555d-49c5-89d3-da3ab1007684 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:34.827703 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7f67c944-555d-49c5-89d3-da3ab1007684 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:34.834668 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f67c944-555d-49c5-89d3-da3ab1007684 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:34.835307 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f67c944-555d-49c5-89d3-da3ab1007684 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:34.836211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f67c944-555d-49c5-89d3-da3ab1007684 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:34.836698 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f67c944-555d-49c5-89d3-da3ab1007684 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.140859 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7f67c944-555d-49c5-89d3-da3ab1007684 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:35.153259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7f67c944-555d-49c5-89d3-da3ab1007684 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.339805 Aug 01 14:11:35.163105 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 232/463] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:34 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:35.260655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-a9e9930f-8b9b-4fef-bad1-1cdbd3ea6ea5 req-50c0a7f8-ca67-4ff2-8a7b-2f9b45c1e60c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb60b84-0a48-4c71-90d0-bb0ad32e66a3", "name": "network-vif-plugged", "status": "completed", "tag": "ca8de692-90c9-403a-8384-f27a86a2d499"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:35.276295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-a9e9930f-8b9b-4fef-bad1-1cdbd3ea6ea5 req-50c0a7f8-ca67-4ff2-8a7b-2f9b45c1e60c service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.277114 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-a9e9930f-8b9b-4fef-bad1-1cdbd3ea6ea5 req-50c0a7f8-ca67-4ff2-8a7b-2f9b45c1e60c service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.294824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-a9e9930f-8b9b-4fef-bad1-1cdbd3ea6ea5 req-50c0a7f8-ca67-4ff2-8a7b-2f9b45c1e60c service nova] Creating event network-vif-plugged:ca8de692-90c9-403a-8384-f27a86a2d499 for instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 on hv-cinder-84713 Aug 01 14:11:35.301982 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-a9e9930f-8b9b-4fef-bad1-1cdbd3ea6ea5 req-50c0a7f8-ca67-4ff2-8a7b-2f9b45c1e60c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051027 Aug 01 14:11:35.304492 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 232/464] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:35.766650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-add7cd88-3b6f-4995-864a-8057baf610fb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:35.767432 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-add7cd88-3b6f-4995-864a-8057baf610fb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:35.775373 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-add7cd88-3b6f-4995-864a-8057baf610fb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.775835 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-add7cd88-3b6f-4995-864a-8057baf610fb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:35.784612 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-add7cd88-3b6f-4995-864a-8057baf610fb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:35.785199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-add7cd88-3b6f-4995-864a-8057baf610fb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:36.123920 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-add7cd88-3b6f-4995-864a-8057baf610fb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:36.132855 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-add7cd88-3b6f-4995-864a-8057baf610fb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1510 microversion: 2.1 time: 0.371679 Aug 01 14:11:36.134026 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 233/465] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:35 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1510 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:36.194266 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6d7a0aed-287c-4915-b899-50e4d5ceb8d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:36.195423 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6d7a0aed-287c-4915-b899-50e4d5ceb8d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:36.210895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7a0aed-287c-4915-b899-50e4d5ceb8d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:36.211649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7a0aed-287c-4915-b899-50e4d5ceb8d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:36.212925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7a0aed-287c-4915-b899-50e4d5ceb8d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:36.213363 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d7a0aed-287c-4915-b899-50e4d5ceb8d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:36.412144 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d7a0aed-287c-4915-b899-50e4d5ceb8d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:36.424002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6d7a0aed-287c-4915-b899-50e4d5ceb8d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.233940 Aug 01 14:11:36.429902 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 233/466] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:36 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:37.155016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9056d92e-2e8f-47d2-8769-66ca4720ec6f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:37.155849 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9056d92e-2e8f-47d2-8769-66ca4720ec6f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:37.163063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9056d92e-2e8f-47d2-8769-66ca4720ec6f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.163618 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9056d92e-2e8f-47d2-8769-66ca4720ec6f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.164473 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9056d92e-2e8f-47d2-8769-66ca4720ec6f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.165117 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9056d92e-2e8f-47d2-8769-66ca4720ec6f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.423120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9056d92e-2e8f-47d2-8769-66ca4720ec6f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:37.432831 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9056d92e-2e8f-47d2-8769-66ca4720ec6f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1510 microversion: 2.1 time: 0.282451 Aug 01 14:11:37.438970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 234/467] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:37 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1510 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:37.463124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-93b1ef51-11ba-41d6-af79-f593caddfd70 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:37.464785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-93b1ef51-11ba-41d6-af79-f593caddfd70 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:37.480296 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-93b1ef51-11ba-41d6-af79-f593caddfd70 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.481538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-93b1ef51-11ba-41d6-af79-f593caddfd70 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.483207 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-93b1ef51-11ba-41d6-af79-f593caddfd70 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:37.483893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-93b1ef51-11ba-41d6-af79-f593caddfd70 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:37.731661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-93b1ef51-11ba-41d6-af79-f593caddfd70 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:37.739722 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-93b1ef51-11ba-41d6-af79-f593caddfd70 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.292915 Aug 01 14:11:37.740310 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 234/468] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:37 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:38.463726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d992e7b5-0e3f-44aa-be57-c77696fd9e44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:38.464375 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d992e7b5-0e3f-44aa-be57-c77696fd9e44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:38.474166 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d992e7b5-0e3f-44aa-be57-c77696fd9e44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:38.474691 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d992e7b5-0e3f-44aa-be57-c77696fd9e44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:38.475616 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d992e7b5-0e3f-44aa-be57-c77696fd9e44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:38.475991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d992e7b5-0e3f-44aa-be57-c77696fd9e44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:38.742957 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d992e7b5-0e3f-44aa-be57-c77696fd9e44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:38.764106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-746f7df0-081b-4b42-accb-441d39076637 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:38.765851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-746f7df0-081b-4b42-accb-441d39076637 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:38.787614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-746f7df0-081b-4b42-accb-441d39076637 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:38.788513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-746f7df0-081b-4b42-accb-441d39076637 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:38.789828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-746f7df0-081b-4b42-accb-441d39076637 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:38.790937 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d992e7b5-0e3f-44aa-be57-c77696fd9e44 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1516 microversion: 2.1 time: 0.331394 Aug 01 14:11:38.791606 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-746f7df0-081b-4b42-accb-441d39076637 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:38.792432 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 235/469] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:38 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1516 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:39.012996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-746f7df0-081b-4b42-accb-441d39076637 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:39.025867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-746f7df0-081b-4b42-accb-441d39076637 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.265780 Aug 01 14:11:39.027318 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 235/470] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:38 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:39.870709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fc19a6f2-9b44-4cca-99ef-d8972bf7dc35 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Action: 'create', calling method: .version_select at 0x7f4462e52280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-162466780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8HYSLKwEqIlyOncSOQ9KBhTc9PrffxUHCTWZyhfEmZIZS66SJO0Y8FpJhQBLSQjPT9iUECJH3AMPGRK1x03nGhuvI8AHNxIEqTcFfxS6tf41NMyjeUKZjYv4MwFz3sww=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:39.886753 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-fc19a6f2-9b44-4cca-99ef-d8972bf7dc35 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Getting quotas for project 7bb93e302f1441fca85409de83230d6a. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:39.891942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-fc19a6f2-9b44-4cca-99ef-d8972bf7dc35 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Getting quotas for user 2eb09df64dd74ddeb9fbbf44ae0a3592 and project 7bb93e302f1441fca85409de83230d6a. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:39.918083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fc19a6f2-9b44-4cca-99ef-d8972bf7dc35 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.228082 Aug 01 14:11:39.918685 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 236/471] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:11:39 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:40.048752 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-de63e646-718b-4916-99f7-a4409121d027 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:40.049464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-de63e646-718b-4916-99f7-a4409121d027 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:40.059313 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de63e646-718b-4916-99f7-a4409121d027 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.059772 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de63e646-718b-4916-99f7-a4409121d027 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.060664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de63e646-718b-4916-99f7-a4409121d027 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.061110 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-de63e646-718b-4916-99f7-a4409121d027 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.296135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-de63e646-718b-4916-99f7-a4409121d027 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:40.304256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:40.310668 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-de63e646-718b-4916-99f7-a4409121d027 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1363 microversion: 2.1 time: 0.266709 Aug 01 14:11:40.312428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 236/472] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:40 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:40.585361 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1cfdcbb2-17d8-41f9-9d6c-a52d3a5ed9e2 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:40.586138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1cfdcbb2-17d8-41f9-9d6c-a52d3a5ed9e2 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:40.594428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1cfdcbb2-17d8-41f9-9d6c-a52d3a5ed9e2 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.595283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1cfdcbb2-17d8-41f9-9d6c-a52d3a5ed9e2 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.596339 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1cfdcbb2-17d8-41f9-9d6c-a52d3a5ed9e2 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:40.597019 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1cfdcbb2-17d8-41f9-9d6c-a52d3a5ed9e2 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:40.819111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1cfdcbb2-17d8-41f9-9d6c-a52d3a5ed9e2 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:40.831229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1cfdcbb2-17d8-41f9-9d6c-a52d3a5ed9e2 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1593 microversion: 2.1 time: 0.249587 Aug 01 14:11:40.834605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 237/473] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:40 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1593 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:41.338111 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-60c35761-6ffe-40ec-ab49-081370299f54 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:41.338828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-60c35761-6ffe-40ec-ab49-081370299f54 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:41.339230 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-073b68b8-2735-4133-837a-690b8a0a1b3f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'create', calling method: .version_select at 0x7f4462e9bb80>, body: {"keypair": {"name": "tempest-keypair-1132266031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKH7wFSFY1xe3XM9JOEm7Hp2Un31pyQB+nsEcuuOYNFy0ck0q1AANFbD2d7yaplNrV16QAs5kcrTXE0pmPYccRETLmGhVqIWct939w2YcOl63eQUVgyq3De+6b2lL344/g=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:41.351894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60c35761-6ffe-40ec-ab49-081370299f54 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:41.356524 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60c35761-6ffe-40ec-ab49-081370299f54 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.357576 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60c35761-6ffe-40ec-ab49-081370299f54 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:41.359851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60c35761-6ffe-40ec-ab49-081370299f54 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.364037 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-073b68b8-2735-4133-837a-690b8a0a1b3f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Getting quotas for project 670dbffe4aed43c6afc3899ff59b8040. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:41.376310 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-073b68b8-2735-4133-837a-690b8a0a1b3f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Getting quotas for user f379b005418a4e399c3b72cbbef6e00d and project 670dbffe4aed43c6afc3899ff59b8040. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:41.407762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-073b68b8-2735-4133-837a-690b8a0a1b3f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072701 Aug 01 14:11:41.408474 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 238/474] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:11:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:11:41.594158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-60c35761-6ffe-40ec-ab49-081370299f54 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:41.603009 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-60c35761-6ffe-40ec-ab49-081370299f54 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1548 microversion: 2.1 time: 0.274896 Aug 01 14:11:41.617576 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 237/475] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:41 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1548 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:41.628082 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1b1d2f3e-6f62-4c27-822c-a5d36cc607ee tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:41.628792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1b1d2f3e-6f62-4c27-822c-a5d36cc607ee tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:41.640626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1b1d2f3e-6f62-4c27-822c-a5d36cc607ee tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:41.641251 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1b1d2f3e-6f62-4c27-822c-a5d36cc607ee tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.642772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1b1d2f3e-6f62-4c27-822c-a5d36cc607ee tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:41.643378 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1b1d2f3e-6f62-4c27-822c-a5d36cc607ee tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:41.870565 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1b1d2f3e-6f62-4c27-822c-a5d36cc607ee tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.247099 Aug 01 14:11:41.871185 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 239/476] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 14:11:41 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/os-interface => generated 284 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:43.789123 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-4ee45975-7197-4711-b149-da6e68b4a450 req-007ee101-fbcd-4110-a205-45edd343a1cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb60b84-0a48-4c71-90d0-bb0ad32e66a3", "tag": "ca8de692-90c9-403a-8384-f27a86a2d499"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:43.809264 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4ee45975-7197-4711-b149-da6e68b4a450 req-007ee101-fbcd-4110-a205-45edd343a1cf service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:43.813513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4ee45975-7197-4711-b149-da6e68b4a450 req-007ee101-fbcd-4110-a205-45edd343a1cf service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:43.833589 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-4ee45975-7197-4711-b149-da6e68b4a450 req-007ee101-fbcd-4110-a205-45edd343a1cf service nova] Creating event network-changed:ca8de692-90c9-403a-8384-f27a86a2d499 for instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 on hv-cinder-84713 Aug 01 14:11:43.839749 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-4ee45975-7197-4711-b149-da6e68b4a450 req-007ee101-fbcd-4110-a205-45edd343a1cf service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062526 Aug 01 14:11:43.841115 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 238/477] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:44.333504 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-2ff627fe-b54b-4109-95a1-f498d06284e3 req-133b5769-2a15-4254-ba3e-3c8da2ff2a1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0b1caa-a17e-4a0f-b54e-9d0be62f316d", "tag": "49a0f089-f785-418c-9210-780bc0f62f14"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:44.353283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-2ff627fe-b54b-4109-95a1-f498d06284e3 req-133b5769-2a15-4254-ba3e-3c8da2ff2a1e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:44.354047 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-2ff627fe-b54b-4109-95a1-f498d06284e3 req-133b5769-2a15-4254-ba3e-3c8da2ff2a1e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:44.379386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-2ff627fe-b54b-4109-95a1-f498d06284e3 req-133b5769-2a15-4254-ba3e-3c8da2ff2a1e service nova] Creating event network-changed:49a0f089-f785-418c-9210-780bc0f62f14 for instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d on hv-cinder-84713 Aug 01 14:11:44.397644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-2ff627fe-b54b-4109-95a1-f498d06284e3 req-133b5769-2a15-4254-ba3e-3c8da2ff2a1e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068541 Aug 01 14:11:44.398256 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 240/478] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:45.416953 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1715372166", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f97ce0db-2b99-49a1-bd13-dbbdc6c7df23"}], "security_groups": [{"name": "tempest-securitygroup--1630790441"}], "key_name": "tempest-keypair-1132266031", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:46.055862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bf9aac04-d7ea-4fe2-bc80-9cd4e758494d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1435224631"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:46.056497 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bf9aac04-d7ea-4fe2-bc80-9cd4e758494d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:46.063864 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bf9aac04-d7ea-4fe2-bc80-9cd4e758494d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.064307 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bf9aac04-d7ea-4fe2-bc80-9cd4e758494d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:46.065171 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bf9aac04-d7ea-4fe2-bc80-9cd4e758494d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.065604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bf9aac04-d7ea-4fe2-bc80-9cd4e758494d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:46.203624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.network.security_group_api [None req-bf9aac04-d7ea-4fe2-bc80-9cd4e758494d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Adding security group a380e009-93fb-49c3-aa11-b79b4a7edc7f to port 49a0f089-f785-418c-9210-780bc0f62f14 Aug 01 14:11:46.624809 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bf9aac04-d7ea-4fe2-bc80-9cd4e758494d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "POST /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/action" status: 202 len: 0 microversion: 2.1 time: 0.573808 Aug 01 14:11:46.625808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 241/479] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:11:46 2022] POST /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/action => generated 0 bytes in 576 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:11:46.643699 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-5ea5e857-2b44-489f-a977-944d17c3addd req-3076b1f1-29c0-4fe4-bf02-2a51e0375b4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0b1caa-a17e-4a0f-b54e-9d0be62f316d", "tag": "49a0f089-f785-418c-9210-780bc0f62f14"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:46.655797 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-5ea5e857-2b44-489f-a977-944d17c3addd req-3076b1f1-29c0-4fe4-bf02-2a51e0375b4d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.656246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-5ea5e857-2b44-489f-a977-944d17c3addd req-3076b1f1-29c0-4fe4-bf02-2a51e0375b4d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:46.668463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-5ea5e857-2b44-489f-a977-944d17c3addd req-3076b1f1-29c0-4fe4-bf02-2a51e0375b4d service nova] Creating event network-changed:49a0f089-f785-418c-9210-780bc0f62f14 for instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d on hv-cinder-84713 Aug 01 14:11:46.674316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-5ea5e857-2b44-489f-a977-944d17c3addd req-3076b1f1-29c0-4fe4-bf02-2a51e0375b4d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044097 Aug 01 14:11:46.675497 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 242/480] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:46.680874 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2aa64f64-57e2-4b11-9add-4a53cc61aac6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:46.681933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2aa64f64-57e2-4b11-9add-4a53cc61aac6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:46.688966 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2aa64f64-57e2-4b11-9add-4a53cc61aac6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.689640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2aa64f64-57e2-4b11-9add-4a53cc61aac6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:46.690580 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2aa64f64-57e2-4b11-9add-4a53cc61aac6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:46.691173 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2aa64f64-57e2-4b11-9add-4a53cc61aac6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:46.880778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2aa64f64-57e2-4b11-9add-4a53cc61aac6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:46.891463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2aa64f64-57e2-4b11-9add-4a53cc61aac6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1759 microversion: 2.1 time: 0.214652 Aug 01 14:11:46.892189 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 243/481] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:46 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1759 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:48.439897 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] validate_networks() for [('f97ce0db-2b99-49a1-bd13-dbbdc6c7df23', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:11:48.627376 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=86 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:48.823517 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:11:48.823944 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:11:48.824417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:11:48.824855 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:11:48.825269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:11:48.834079 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:48.834522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:48.835311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:48.835741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:48.853397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Getting quotas for project 670dbffe4aed43c6afc3899ff59b8040. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:11:48.857897 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Getting quotas for user f379b005418a4e399c3b72cbbef6e00d and project 670dbffe4aed43c6afc3899ff59b8040. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:11:48.869185 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:11:48.871480 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:11:48.917115 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3655c0e6-ac2d-4b5d-b450-4552e780682a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.507303 Aug 01 14:11:48.917795 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 239/482] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:11:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 3509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:11:48.929184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-92ac3a3b-c9d8-4cba-bb00-97374506ec59 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:48.929792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-92ac3a3b-c9d8-4cba-bb00-97374506ec59 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:48.996053 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-92ac3a3b-c9d8-4cba-bb00-97374506ec59 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:49.003727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-92ac3a3b-c9d8-4cba-bb00-97374506ec59 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1246 microversion: 2.1 time: 0.078345 Aug 01 14:11:49.004295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 244/483] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:48 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1246 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:50.025779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-80121e3f-56cf-47ed-8cab-71c4f2c56906 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:50.027908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-80121e3f-56cf-47ed-8cab-71c4f2c56906 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:50.036291 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80121e3f-56cf-47ed-8cab-71c4f2c56906 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:50.037141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80121e3f-56cf-47ed-8cab-71c4f2c56906 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:50.037950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80121e3f-56cf-47ed-8cab-71c4f2c56906 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:50.038395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80121e3f-56cf-47ed-8cab-71c4f2c56906 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:50.113966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-80121e3f-56cf-47ed-8cab-71c4f2c56906 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:50.121685 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-80121e3f-56cf-47ed-8cab-71c4f2c56906 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1306 microversion: 2.1 time: 0.100683 Aug 01 14:11:50.123027 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 240/484] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:50 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1306 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:51.146729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-38e496a6-f07a-4536-8e8b-457171e567dd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:51.147939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-38e496a6-f07a-4536-8e8b-457171e567dd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:51.156138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:51.163857 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38e496a6-f07a-4536-8e8b-457171e567dd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.164669 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38e496a6-f07a-4536-8e8b-457171e567dd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.166190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38e496a6-f07a-4536-8e8b-457171e567dd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.167071 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38e496a6-f07a-4536-8e8b-457171e567dd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.316031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-38e496a6-f07a-4536-8e8b-457171e567dd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:51.323542 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-38e496a6-f07a-4536-8e8b-457171e567dd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.183355 Aug 01 14:11:51.324110 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 245/485] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:51 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:11:51.613828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-78224182-525e-4761-b6ff-4f35eb945cd2 req-56a4dfd9-2d5e-4666-b617-ec838b63a19f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bc4793-88a4-4bc0-a99d-c5161e63842b", "tag": "95fff2c9-f9b3-439e-a613-9ea37938dcf9"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:11:51.624049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-78224182-525e-4761-b6ff-4f35eb945cd2 req-56a4dfd9-2d5e-4666-b617-ec838b63a19f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:51.624504 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-78224182-525e-4761-b6ff-4f35eb945cd2 req-56a4dfd9-2d5e-4666-b617-ec838b63a19f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:51.636720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-78224182-525e-4761-b6ff-4f35eb945cd2 req-56a4dfd9-2d5e-4666-b617-ec838b63a19f service nova] Creating event network-changed:95fff2c9-f9b3-439e-a613-9ea37938dcf9 for instance c9bc4793-88a4-4bc0-a99d-c5161e63842b on hv-cinder-84713 Aug 01 14:11:51.641996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-78224182-525e-4761-b6ff-4f35eb945cd2 req-56a4dfd9-2d5e-4666-b617-ec838b63a19f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032315 Aug 01 14:11:51.642591 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 241/486] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:11:52.345264 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ca188193-f7dc-41a0-a9f7-a539a6b9715d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:52.345902 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ca188193-f7dc-41a0-a9f7-a539a6b9715d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:52.352955 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ca188193-f7dc-41a0-a9f7-a539a6b9715d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:52.353403 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ca188193-f7dc-41a0-a9f7-a539a6b9715d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:52.354164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ca188193-f7dc-41a0-a9f7-a539a6b9715d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:52.354599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ca188193-f7dc-41a0-a9f7-a539a6b9715d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:52.492379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ca188193-f7dc-41a0-a9f7-a539a6b9715d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:52.500600 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ca188193-f7dc-41a0-a9f7-a539a6b9715d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.159812 Aug 01 14:11:52.501123 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 246/487] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:52 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:53.523933 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-612dae8e-d9ac-4f7a-b2dd-16a2522e3bbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:53.524667 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-612dae8e-d9ac-4f7a-b2dd-16a2522e3bbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:53.531454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-612dae8e-d9ac-4f7a-b2dd-16a2522e3bbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:53.531891 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-612dae8e-d9ac-4f7a-b2dd-16a2522e3bbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:53.532671 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-612dae8e-d9ac-4f7a-b2dd-16a2522e3bbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:53.533099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-612dae8e-d9ac-4f7a-b2dd-16a2522e3bbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:53.664159 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-612dae8e-d9ac-4f7a-b2dd-16a2522e3bbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:53.672014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-612dae8e-d9ac-4f7a-b2dd-16a2522e3bbc tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.152194 Aug 01 14:11:53.672604 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 242/488] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:53 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:54.692562 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-23c57e06-3a7e-47bf-93ff-6dd7ddf1211f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:54.693176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-23c57e06-3a7e-47bf-93ff-6dd7ddf1211f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:54.699700 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-23c57e06-3a7e-47bf-93ff-6dd7ddf1211f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.700151 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-23c57e06-3a7e-47bf-93ff-6dd7ddf1211f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.700952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-23c57e06-3a7e-47bf-93ff-6dd7ddf1211f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:54.701393 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-23c57e06-3a7e-47bf-93ff-6dd7ddf1211f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:54.833825 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-23c57e06-3a7e-47bf-93ff-6dd7ddf1211f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:54.841549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-23c57e06-3a7e-47bf-93ff-6dd7ddf1211f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.152865 Aug 01 14:11:54.842610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 247/489] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:54 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:55.863055 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2139c798-04ff-4fb0-bf4f-125a2e28e6eb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:55.863674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2139c798-04ff-4fb0-bf4f-125a2e28e6eb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:55.869680 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2139c798-04ff-4fb0-bf4f-125a2e28e6eb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.870131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2139c798-04ff-4fb0-bf4f-125a2e28e6eb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:55.870899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2139c798-04ff-4fb0-bf4f-125a2e28e6eb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:55.871334 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2139c798-04ff-4fb0-bf4f-125a2e28e6eb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:56.004099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2139c798-04ff-4fb0-bf4f-125a2e28e6eb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:56.011512 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2139c798-04ff-4fb0-bf4f-125a2e28e6eb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.152319 Aug 01 14:11:56.012074 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 243/490] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:55 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:57.031552 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7fd87677-0aa4-41da-bc47-713a6d86aa7c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:57.032170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7fd87677-0aa4-41da-bc47-713a6d86aa7c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:57.038871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7fd87677-0aa4-41da-bc47-713a6d86aa7c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:57.039323 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7fd87677-0aa4-41da-bc47-713a6d86aa7c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:57.040093 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7fd87677-0aa4-41da-bc47-713a6d86aa7c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:57.040560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7fd87677-0aa4-41da-bc47-713a6d86aa7c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:57.172697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7fd87677-0aa4-41da-bc47-713a6d86aa7c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:57.179929 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7fd87677-0aa4-41da-bc47-713a6d86aa7c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.152768 Aug 01 14:11:57.180526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 248/491] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:57 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:58.200084 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9340cecb-7226-4507-9939-0331b660743a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:58.200844 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9340cecb-7226-4507-9939-0331b660743a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:58.206986 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9340cecb-7226-4507-9939-0331b660743a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:58.207435 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9340cecb-7226-4507-9939-0331b660743a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:58.208200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9340cecb-7226-4507-9939-0331b660743a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:58.208664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9340cecb-7226-4507-9939-0331b660743a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:58.359699 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9340cecb-7226-4507-9939-0331b660743a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:58.367987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9340cecb-7226-4507-9939-0331b660743a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.171762 Aug 01 14:11:58.368575 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 244/492] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:58 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:11:59.389198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-32721148-82fc-4f39-b87a-4eacee949564 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:11:59.389833 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-32721148-82fc-4f39-b87a-4eacee949564 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:11:59.392111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=10 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:59.397530 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-32721148-82fc-4f39-b87a-4eacee949564 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.397980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-32721148-82fc-4f39-b87a-4eacee949564 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.398731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-32721148-82fc-4f39-b87a-4eacee949564 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:11:59.399162 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-32721148-82fc-4f39-b87a-4eacee949564 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:11:59.526440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-32721148-82fc-4f39-b87a-4eacee949564 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:11:59.534478 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-32721148-82fc-4f39-b87a-4eacee949564 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.149106 Aug 01 14:11:59.535038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 249/493] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:11:59 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:00.555495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-35aeab78-ae54-4d63-8ff5-dd6f9281964c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:00.556104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-35aeab78-ae54-4d63-8ff5-dd6f9281964c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:00.558094 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:00.558800 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:00.565636 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35aeab78-ae54-4d63-8ff5-dd6f9281964c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.566085 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35aeab78-ae54-4d63-8ff5-dd6f9281964c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.566845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35aeab78-ae54-4d63-8ff5-dd6f9281964c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:00.567283 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35aeab78-ae54-4d63-8ff5-dd6f9281964c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:00.691410 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-35aeab78-ae54-4d63-8ff5-dd6f9281964c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:00.698659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-35aeab78-ae54-4d63-8ff5-dd6f9281964c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.146921 Aug 01 14:12:00.699220 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 245/494] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:00 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:01.720950 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7bbeb5ab-b511-457c-affc-85e155f92e79 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:01.721568 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7bbeb5ab-b511-457c-affc-85e155f92e79 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:01.727996 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bbeb5ab-b511-457c-affc-85e155f92e79 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:01.728449 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bbeb5ab-b511-457c-affc-85e155f92e79 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.729334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bbeb5ab-b511-457c-affc-85e155f92e79 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:01.729718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bbeb5ab-b511-457c-affc-85e155f92e79 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.746362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-d9d04237-317e-4322-97e1-13ae33a3e711 req-8e06349f-6a92-489f-ad18-60f60579b219 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bc4793-88a4-4bc0-a99d-c5161e63842b", "name": "network-vif-plugged", "status": "completed", "tag": "95fff2c9-f9b3-439e-a613-9ea37938dcf9"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:01.759389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d9d04237-317e-4322-97e1-13ae33a3e711 req-8e06349f-6a92-489f-ad18-60f60579b219 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:01.760040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d9d04237-317e-4322-97e1-13ae33a3e711 req-8e06349f-6a92-489f-ad18-60f60579b219 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:01.772900 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-d9d04237-317e-4322-97e1-13ae33a3e711 req-8e06349f-6a92-489f-ad18-60f60579b219 service nova] Creating event network-vif-plugged:95fff2c9-f9b3-439e-a613-9ea37938dcf9 for instance c9bc4793-88a4-4bc0-a99d-c5161e63842b on hv-cinder-84713 Aug 01 14:12:01.778012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-d9d04237-317e-4322-97e1-13ae33a3e711 req-8e06349f-6a92-489f-ad18-60f60579b219 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036022 Aug 01 14:12:01.778629 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 246/495] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:01.870462 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7bbeb5ab-b511-457c-affc-85e155f92e79 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:01.878564 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7bbeb5ab-b511-457c-affc-85e155f92e79 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.161545 Aug 01 14:12:01.879138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 250/496] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:01 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:02.899768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-20bda0ef-5f7d-425c-9dea-6c58c896eeed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:02.900453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-20bda0ef-5f7d-425c-9dea-6c58c896eeed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:02.906646 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20bda0ef-5f7d-425c-9dea-6c58c896eeed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.907087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20bda0ef-5f7d-425c-9dea-6c58c896eeed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:02.907857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20bda0ef-5f7d-425c-9dea-6c58c896eeed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:02.908285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20bda0ef-5f7d-425c-9dea-6c58c896eeed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:03.038015 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-20bda0ef-5f7d-425c-9dea-6c58c896eeed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:03.045363 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-20bda0ef-5f7d-425c-9dea-6c58c896eeed tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.149753 Aug 01 14:12:03.045934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 247/497] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:02 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:04.066066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3ad0aef1-a761-4a07-b444-1c6cfc8701ac tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:04.066683 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3ad0aef1-a761-4a07-b444-1c6cfc8701ac tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:04.073394 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3ad0aef1-a761-4a07-b444-1c6cfc8701ac tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.073849 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3ad0aef1-a761-4a07-b444-1c6cfc8701ac tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.074611 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3ad0aef1-a761-4a07-b444-1c6cfc8701ac tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.075050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3ad0aef1-a761-4a07-b444-1c6cfc8701ac tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.078963 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=91 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:04.205952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3ad0aef1-a761-4a07-b444-1c6cfc8701ac tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:04.213713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3ad0aef1-a761-4a07-b444-1c6cfc8701ac tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1372 microversion: 2.1 time: 0.151464 Aug 01 14:12:04.214274 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 251/498] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:04 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:04.427496 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3f45162d-a878-4765-8835-a55080dafed3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:04.427989 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3f45162d-a878-4765-8835-a55080dafed3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:04.434144 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f45162d-a878-4765-8835-a55080dafed3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.434600 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f45162d-a878-4765-8835-a55080dafed3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.435364 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f45162d-a878-4765-8835-a55080dafed3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.435804 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3f45162d-a878-4765-8835-a55080dafed3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.458061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3f45162d-a878-4765-8835-a55080dafed3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/ips" status: 200 len: 153 microversion: 2.20 time: 0.034640 Aug 01 14:12:04.458630 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 248/499] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Aug 1 14:12:04 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/ips => generated 153 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:12:04.540291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8889abdc-d616-44b3-bc12-bd26bd76f6b6 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a94aeb3-5058-4514-a7a0-5a001927948c", "device": "/dev/sdb"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:04.543356 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8889abdc-d616-44b3-bc12-bd26bd76f6b6 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:04.550064 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8889abdc-d616-44b3-bc12-bd26bd76f6b6 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.550517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8889abdc-d616-44b3-bc12-bd26bd76f6b6 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:04.551283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8889abdc-d616-44b3-bc12-bd26bd76f6b6 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:04.551722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8889abdc-d616-44b3-bc12-bd26bd76f6b6 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.234495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a533b50-ee6d-4cb2-a21d-ee644431f4d3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:05.235099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a533b50-ee6d-4cb2-a21d-ee644431f4d3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:05.241199 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a533b50-ee6d-4cb2-a21d-ee644431f4d3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.241656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a533b50-ee6d-4cb2-a21d-ee644431f4d3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.242416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a533b50-ee6d-4cb2-a21d-ee644431f4d3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.243011 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a533b50-ee6d-4cb2-a21d-ee644431f4d3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.375459 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a533b50-ee6d-4cb2-a21d-ee644431f4d3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:05.383697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a533b50-ee6d-4cb2-a21d-ee644431f4d3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1566 microversion: 2.1 time: 0.152999 Aug 01 14:12:05.384305 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 249/500] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:05 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:05.404684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a8f116eb-6a84-456b-a8ed-f360cd0c988c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:05.405260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a8f116eb-6a84-456b-a8ed-f360cd0c988c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:05.411450 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a8f116eb-6a84-456b-a8ed-f360cd0c988c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.411897 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a8f116eb-6a84-456b-a8ed-f360cd0c988c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.412706 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a8f116eb-6a84-456b-a8ed-f360cd0c988c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:05.413135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a8f116eb-6a84-456b-a8ed-f360cd0c988c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:05.466595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8889abdc-d616-44b3-bc12-bd26bd76f6b6 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "POST /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.930085 Aug 01 14:12:05.467450 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 252/501] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:12:04 2022] POST /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3/os-volume_attachments => generated 194 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:05.506006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a8f116eb-6a84-456b-a8ed-f360cd0c988c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104973 Aug 01 14:12:05.506945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 250/502] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 14:12:05 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:12:06.701557 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-b3691f79-a01b-48de-a47d-1ae11389f1e3 req-362922e6-1da9-4edc-b4bd-f979591354e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bc4793-88a4-4bc0-a99d-c5161e63842b", "tag": "95fff2c9-f9b3-439e-a613-9ea37938dcf9"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:06.711560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-b3691f79-a01b-48de-a47d-1ae11389f1e3 req-362922e6-1da9-4edc-b4bd-f979591354e5 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:06.712003 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-b3691f79-a01b-48de-a47d-1ae11389f1e3 req-362922e6-1da9-4edc-b4bd-f979591354e5 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:06.724002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-b3691f79-a01b-48de-a47d-1ae11389f1e3 req-362922e6-1da9-4edc-b4bd-f979591354e5 service nova] Creating event network-changed:95fff2c9-f9b3-439e-a613-9ea37938dcf9 for instance c9bc4793-88a4-4bc0-a99d-c5161e63842b on hv-cinder-84713 Aug 01 14:12:06.728875 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-b3691f79-a01b-48de-a47d-1ae11389f1e3 req-362922e6-1da9-4edc-b4bd-f979591354e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031913 Aug 01 14:12:06.729759 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 253/503] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:12:07.385018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fd4e29b4-97e0-4272-a04c-c52b8acdb7d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:07.385545 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fd4e29b4-97e0-4272-a04c-c52b8acdb7d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:07.392285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd4e29b4-97e0-4272-a04c-c52b8acdb7d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.392765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd4e29b4-97e0-4272-a04c-c52b8acdb7d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.393542 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd4e29b4-97e0-4272-a04c-c52b8acdb7d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.393976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd4e29b4-97e0-4272-a04c-c52b8acdb7d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.417640 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-fd4e29b4-97e0-4272-a04c-c52b8acdb7d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lazy-loading 'flavor' on Instance uuid 51fd7ad6-9939-4561-b0fa-f45f8602eccf {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:12:07.660708 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fd4e29b4-97e0-4272-a04c-c52b8acdb7d9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/action" status: 202 len: 0 microversion: 2.20 time: 0.279510 Aug 01 14:12:07.661475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 251/504] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 14:12:07 2022] POST /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:12:07.671025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:07.671740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:07.679590 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.680083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.680948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:07.681427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:07.827131 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:07.836201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:07.837761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:07.838963 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-50ae1ff4-ba67-4a79-9b66-5182e83a2561 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.172936 Aug 01 14:12:07.839724 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 254/505] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:07 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:08.864418 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:08.865333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:08.872061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:08.872534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:08.873321 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:08.873747 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:09.004750 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:09.012649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:09.014152 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:09.015297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be8a93ab-888a-4f10-ac20-25b1079e7270 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.156550 Aug 01 14:12:09.015914 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 252/506] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:08 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:10.039678 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:10.040332 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:10.047423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:10.047879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:10.048687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:10.049134 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:10.179448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:10.187923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:10.189411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:10.190598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c58a104d-4f1e-432e-b4a4-5480f1b0ba82 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.154801 Aug 01 14:12:10.191162 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 255/507] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:10 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:11.212994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:11.213594 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:11.219655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:11.220098 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:11.220876 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:11.221311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:11.346174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:11.354027 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:11.355537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:11.356736 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-02528360-d29b-41c0-95bd-8ab4c59ef4d0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.148148 Aug 01 14:12:11.357295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 253/508] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:11 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:12.380308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:12.380979 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:12.387361 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.387808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.388600 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:12.389041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:12.529174 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:12.537072 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:12.538585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:12.539755 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8d200fc1-d849-4918-a119-436b34dba4f2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.163466 Aug 01 14:12:12.540344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 256/509] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:12 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:12.984889 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-547725719", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-162466780", "security_groups": [{"name": "tempest-secgroup-smoke-1640434700"}], "block_device_mapping_v2": [{"uuid": "e8e12192-2e60-44e8-937f-0b6a214152f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "867b8e09-a18b-436d-b07f-57394adda503"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:13.095631 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] validate_networks() for [('867b8e09-a18b-436d-b07f-57394adda503', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:12:13.456670 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:12:13.457086 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:12:13.457557 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:12:13.457966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:12:13.458376 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:12:13.468908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.469352 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.470145 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.470583 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.477271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:13.490895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Getting quotas for project 7bb93e302f1441fca85409de83230d6a. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:12:13.495073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Getting quotas for user 2eb09df64dd74ddeb9fbbf44ae0a3592 and project 7bb93e302f1441fca85409de83230d6a. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:12:13.553649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:12:13.555749 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8e12192-2e60-44e8-937f-0b6a214152f7',volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:12:13.563465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:13.564223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:13.571267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.571653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.572569 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:13.573014 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:13.689294 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d1b1da96-0b10-4aa2-b5de-8f447da50732 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711150 Aug 01 14:12:13.689944 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 254/510] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:12:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:12:13.701339 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-48eec924-9c87-485b-bf62-7f3e6995ed5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:13.701993 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-48eec924-9c87-485b-bf62-7f3e6995ed5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:13.714280 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:13.723646 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:13.725223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:13.726558 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-39f36c17-1438-45d6-8fc9-aac1690f4fef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.167514 Aug 01 14:12:13.728638 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 257/511] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:13 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:13.763639 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-48eec924-9c87-485b-bf62-7f3e6995ed5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:13.770515 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-48eec924-9c87-485b-bf62-7f3e6995ed5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1093 microversion: 2.1 time: 0.073061 Aug 01 14:12:13.771009 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 255/512] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:13 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:14.750630 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:14.751243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:14.757673 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:14.758126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:14.758879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:14.759316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:14.791066 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0577ebe2-9e5d-4a0b-b528-fc84627b66e7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:14.791748 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0577ebe2-9e5d-4a0b-b528-fc84627b66e7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:14.798431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0577ebe2-9e5d-4a0b-b528-fc84627b66e7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:14.801351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0577ebe2-9e5d-4a0b-b528-fc84627b66e7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:14.801351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0577ebe2-9e5d-4a0b-b528-fc84627b66e7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:14.801351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0577ebe2-9e5d-4a0b-b528-fc84627b66e7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:14.869204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0577ebe2-9e5d-4a0b-b528-fc84627b66e7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:14.877335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0577ebe2-9e5d-4a0b-b528-fc84627b66e7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1191 microversion: 2.1 time: 0.090098 Aug 01 14:12:14.877903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 256/513] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:14 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:14.889244 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:14.897155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:14.898651 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:14.899796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-84e11fdf-4a66-40a2-aebc-417a75a54bab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.153607 Aug 01 14:12:14.900345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 258/514] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:14 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:15.898190 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-50502952-06c7-41a4-89d1-b5b52b41458f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:15.898777 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-50502952-06c7-41a4-89d1-b5b52b41458f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:15.904752 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50502952-06c7-41a4-89d1-b5b52b41458f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.905195 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50502952-06c7-41a4-89d1-b5b52b41458f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.905945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50502952-06c7-41a4-89d1-b5b52b41458f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.906370 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-50502952-06c7-41a4-89d1-b5b52b41458f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.923132 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:15.923798 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:15.930348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.930804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.931575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:15.932038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:15.966471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-50502952-06c7-41a4-89d1-b5b52b41458f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:15.974032 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-50502952-06c7-41a4-89d1-b5b52b41458f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1199 microversion: 2.1 time: 0.079633 Aug 01 14:12:15.974619 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 257/515] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:15 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1199 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:16.069099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:16.076979 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:16.078493 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:16.079649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f8e87756-d027-434c-9670-acce7548f5f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.160494 Aug 01 14:12:16.080204 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 259/516] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:15 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:16.995233 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aadd7617-5ac8-401d-abcd-0dedd0dfd967 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:16.995821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aadd7617-5ac8-401d-abcd-0dedd0dfd967 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:17.002529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aadd7617-5ac8-401d-abcd-0dedd0dfd967 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.002974 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aadd7617-5ac8-401d-abcd-0dedd0dfd967 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.003732 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aadd7617-5ac8-401d-abcd-0dedd0dfd967 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.004163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aadd7617-5ac8-401d-abcd-0dedd0dfd967 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.065129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aadd7617-5ac8-401d-abcd-0dedd0dfd967 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:17.072624 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aadd7617-5ac8-401d-abcd-0dedd0dfd967 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1199 microversion: 2.1 time: 0.081168 Aug 01 14:12:17.073125 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 258/517] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:16 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1199 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:17.101485 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:17.102095 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:17.108538 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.108987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.109737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:17.110169 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:17.237477 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:17.245352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:17.247359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:17.248519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d03d0c72-4587-4597-b6b9-63070bd66bd4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.150819 Aug 01 14:12:17.249065 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 260/518] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:17 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:18.094914 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ae7164dc-4004-4e48-be93-8dcb5d2ff9c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:18.095291 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ae7164dc-4004-4e48-be93-8dcb5d2ff9c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:18.101394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae7164dc-4004-4e48-be93-8dcb5d2ff9c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:18.101835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae7164dc-4004-4e48-be93-8dcb5d2ff9c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:18.102582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae7164dc-4004-4e48-be93-8dcb5d2ff9c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:18.103009 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae7164dc-4004-4e48-be93-8dcb5d2ff9c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:18.165378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae7164dc-4004-4e48-be93-8dcb5d2ff9c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:18.173587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ae7164dc-4004-4e48-be93-8dcb5d2ff9c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1199 microversion: 2.1 time: 0.082751 Aug 01 14:12:18.174159 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 259/519] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:18 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1199 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:18.271073 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:18.271688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:18.279004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:18.279454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:18.280223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:18.280695 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:18.407298 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:18.415246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:18.416790 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:18.417947 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8ba45e8a-7620-4cb3-9aa7-4b0267972c5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.150776 Aug 01 14:12:18.418504 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 261/520] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:18 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:19.193547 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e214225b-06c0-47e0-a083-413543e34453 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:19.194817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e214225b-06c0-47e0-a083-413543e34453 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:19.196952 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:19.202686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e214225b-06c0-47e0-a083-413543e34453 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:19.203404 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e214225b-06c0-47e0-a083-413543e34453 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:19.204604 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e214225b-06c0-47e0-a083-413543e34453 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:19.205225 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e214225b-06c0-47e0-a083-413543e34453 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:19.270618 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e214225b-06c0-47e0-a083-413543e34453 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:19.278015 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e214225b-06c0-47e0-a083-413543e34453 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1209 microversion: 2.1 time: 0.088222 Aug 01 14:12:19.278585 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 260/521] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:19 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1209 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:19.441313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:19.442037 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:19.448901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:19.449400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:19.450178 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:19.450617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:19.667123 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:19.676053 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:19.677636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:19.678797 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ef55f370-5f7c-4513-8569-6a309a198148 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.241822 Aug 01 14:12:19.679565 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 262/522] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:19 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:20.299812 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d50c9102-e67d-4630-8b4f-8270340bc339 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:20.300555 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d50c9102-e67d-4630-8b4f-8270340bc339 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:20.306791 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d50c9102-e67d-4630-8b4f-8270340bc339 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.307336 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d50c9102-e67d-4630-8b4f-8270340bc339 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.308211 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d50c9102-e67d-4630-8b4f-8270340bc339 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.308677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d50c9102-e67d-4630-8b4f-8270340bc339 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.419155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-5798e743-cdf4-4a78-90a2-46ba3570c2e0 req-54742e91-58a2-4a7f-ad5e-81b97a1a4b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0c5482-0e86-4a38-8b7e-69b2e4def9e5", "tag": "0adf5e77-fe49-401a-95b7-2047d19a841b"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:20.438399 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-5798e743-cdf4-4a78-90a2-46ba3570c2e0 req-54742e91-58a2-4a7f-ad5e-81b97a1a4b9f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.439276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-5798e743-cdf4-4a78-90a2-46ba3570c2e0 req-54742e91-58a2-4a7f-ad5e-81b97a1a4b9f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.456784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-5798e743-cdf4-4a78-90a2-46ba3570c2e0 req-54742e91-58a2-4a7f-ad5e-81b97a1a4b9f service nova] Creating event network-changed:0adf5e77-fe49-401a-95b7-2047d19a841b for instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 on hv-cinder-84713 Aug 01 14:12:20.464060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-5798e743-cdf4-4a78-90a2-46ba3570c2e0 req-54742e91-58a2-4a7f-ad5e-81b97a1a4b9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052355 Aug 01 14:12:20.465975 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 263/523] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:20.467783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d50c9102-e67d-4630-8b4f-8270340bc339 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:20.480018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d50c9102-e67d-4630-8b4f-8270340bc339 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.183886 Aug 01 14:12:20.481574 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 261/524] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:20 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:20.702645 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:20.703294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:20.709735 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.710445 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.711256 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:20.711699 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:20.928841 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:20.938379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:20.940342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:20.941921 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bf6b8ed8-a004-418b-8344-31811a6ebfb4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.244236 Aug 01 14:12:20.942520 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 264/525] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:20 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:21.502240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a5422c86-cee0-4127-9460-dc32e7a8f7dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:21.502829 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a5422c86-cee0-4127-9460-dc32e7a8f7dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:21.509320 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a5422c86-cee0-4127-9460-dc32e7a8f7dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:21.509776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a5422c86-cee0-4127-9460-dc32e7a8f7dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:21.510541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a5422c86-cee0-4127-9460-dc32e7a8f7dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:21.510975 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a5422c86-cee0-4127-9460-dc32e7a8f7dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:21.856907 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a5422c86-cee0-4127-9460-dc32e7a8f7dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:21.864780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a5422c86-cee0-4127-9460-dc32e7a8f7dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.366261 Aug 01 14:12:21.865443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 262/526] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:21 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:21.966154 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:21.966756 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:21.969160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=40 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:21.974454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:21.974904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:21.975667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:21.976099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:22.106045 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:22.113901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:22.115448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:22.116625 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-912c8e3c-e368-4411-9aba-5fcfbeb0da30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.154888 Aug 01 14:12:22.117188 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 265/527] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:21 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:22.889042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9c015314-1aa4-4c7a-83f3-ed817f50b3e2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:22.889684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9c015314-1aa4-4c7a-83f3-ed817f50b3e2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:22.895663 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c015314-1aa4-4c7a-83f3-ed817f50b3e2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:22.896116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c015314-1aa4-4c7a-83f3-ed817f50b3e2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:22.896917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c015314-1aa4-4c7a-83f3-ed817f50b3e2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:22.897358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c015314-1aa4-4c7a-83f3-ed817f50b3e2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:23.026828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9c015314-1aa4-4c7a-83f3-ed817f50b3e2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:23.034816 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9c015314-1aa4-4c7a-83f3-ed817f50b3e2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.150218 Aug 01 14:12:23.035414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 263/528] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:22 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:23.139762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:23.140367 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:23.146865 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:23.147317 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:23.148071 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:23.148539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:23.278095 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:23.286056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:23.287559 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:23.288746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fc0c75c1-4d9f-4c6c-aca4-688375e5607d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.153500 Aug 01 14:12:23.289311 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 266/529] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:23 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:24.055328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fccea31e-0c3c-4def-999a-da3ac85d2dc9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:24.055944 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fccea31e-0c3c-4def-999a-da3ac85d2dc9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:24.057834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:24.058522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=8 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:24.064421 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fccea31e-0c3c-4def-999a-da3ac85d2dc9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:24.064898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fccea31e-0c3c-4def-999a-da3ac85d2dc9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:24.065666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fccea31e-0c3c-4def-999a-da3ac85d2dc9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:24.066102 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fccea31e-0c3c-4def-999a-da3ac85d2dc9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:24.196522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fccea31e-0c3c-4def-999a-da3ac85d2dc9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:24.203925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fccea31e-0c3c-4def-999a-da3ac85d2dc9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.152575 Aug 01 14:12:24.204549 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 264/530] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:24 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:24.310509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:24.311048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:24.317477 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:24.317920 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:24.318664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:24.319098 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:24.447288 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:24.450085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:24.457266 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:24.458758 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:24.460165 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d3053467-9637-423b-8785-b9fedfff2675 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.153338 Aug 01 14:12:24.460746 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 267/531] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:24 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:25.225317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f7084d50-90b9-4199-8c49-e578ad96ab15 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:25.225924 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f7084d50-90b9-4199-8c49-e578ad96ab15 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:25.231895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7084d50-90b9-4199-8c49-e578ad96ab15 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:25.232341 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7084d50-90b9-4199-8c49-e578ad96ab15 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:25.233124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7084d50-90b9-4199-8c49-e578ad96ab15 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:25.233559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7084d50-90b9-4199-8c49-e578ad96ab15 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:25.358761 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f7084d50-90b9-4199-8c49-e578ad96ab15 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:25.366063 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f7084d50-90b9-4199-8c49-e578ad96ab15 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.144701 Aug 01 14:12:25.366616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 265/532] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:25 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:25.483524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:25.484048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:25.491441 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:25.491884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:25.492661 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:25.493092 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:25.623478 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:25.631353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:25.632880 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:25.634017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b9ccd3a6-586e-429c-a773-cfc4cdca7591 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.154816 Aug 01 14:12:25.634565 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 268/533] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:25 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:26.387093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2824ef2-957b-450f-993b-bdc3c65bb864 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:26.387743 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2824ef2-957b-450f-993b-bdc3c65bb864 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:26.393684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2824ef2-957b-450f-993b-bdc3c65bb864 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:26.394143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2824ef2-957b-450f-993b-bdc3c65bb864 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:26.394906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2824ef2-957b-450f-993b-bdc3c65bb864 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:26.395345 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2824ef2-957b-450f-993b-bdc3c65bb864 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:26.525603 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b2824ef2-957b-450f-993b-bdc3c65bb864 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:26.533696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2824ef2-957b-450f-993b-bdc3c65bb864 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.150450 Aug 01 14:12:26.534264 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 266/534] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:26 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:26.657039 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:26.657652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:26.664049 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:26.664507 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:26.665273 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:26.665711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:26.794017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:26.802261 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:26.803837 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:26.805126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ce044f39-f251-446a-975e-9d7477a3745b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.152660 Aug 01 14:12:26.805785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 269/535] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:26 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:27.554304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8fd02fcc-a575-4d3e-9016-5a487ac36fb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:27.554911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8fd02fcc-a575-4d3e-9016-5a487ac36fb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:27.561560 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8fd02fcc-a575-4d3e-9016-5a487ac36fb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:27.562013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8fd02fcc-a575-4d3e-9016-5a487ac36fb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:27.562774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8fd02fcc-a575-4d3e-9016-5a487ac36fb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:27.563210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8fd02fcc-a575-4d3e-9016-5a487ac36fb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:27.689977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8fd02fcc-a575-4d3e-9016-5a487ac36fb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:27.697317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8fd02fcc-a575-4d3e-9016-5a487ac36fb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.146849 Aug 01 14:12:27.697885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 267/536] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:27 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:27.827132 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:27.828074 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:27.834869 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:27.835324 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:27.836074 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:27.836532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:27.969270 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:27.977056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:27.978567 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:27.980342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-aa8efdd5-c0a5-44de-97e5-ac4d94561b8a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.156469 Aug 01 14:12:27.980940 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 270/537] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:27 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:28.718380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f7097229-85ee-48c2-872c-dbf5e494b6a4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:28.719009 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f7097229-85ee-48c2-872c-dbf5e494b6a4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:28.725032 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7097229-85ee-48c2-872c-dbf5e494b6a4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:28.725489 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7097229-85ee-48c2-872c-dbf5e494b6a4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:28.726247 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7097229-85ee-48c2-872c-dbf5e494b6a4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:28.726681 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7097229-85ee-48c2-872c-dbf5e494b6a4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:28.857466 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f7097229-85ee-48c2-872c-dbf5e494b6a4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:28.864928 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f7097229-85ee-48c2-872c-dbf5e494b6a4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.150941 Aug 01 14:12:28.865488 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 268/538] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:28 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:29.003052 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:29.003595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:29.010282 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:29.010731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:29.011852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:29.012294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:29.143704 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:29.152082 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:29.153638 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:29.154793 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ab0dcb05-e9b0-42cb-b6dc-4be48c26674d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.155714 Aug 01 14:12:29.155351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 271/539] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:28 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:29.886438 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9c7dc2b8-686c-4097-9239-a66417b87670 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:29.887048 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9c7dc2b8-686c-4097-9239-a66417b87670 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:29.893113 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c7dc2b8-686c-4097-9239-a66417b87670 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:29.893554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c7dc2b8-686c-4097-9239-a66417b87670 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:29.894306 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c7dc2b8-686c-4097-9239-a66417b87670 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:29.894740 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9c7dc2b8-686c-4097-9239-a66417b87670 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:30.024710 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9c7dc2b8-686c-4097-9239-a66417b87670 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:30.033704 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9c7dc2b8-686c-4097-9239-a66417b87670 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.151047 Aug 01 14:12:30.034274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 269/540] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:29 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:30.177319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:30.177921 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:30.184465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:30.184935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:30.185686 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:30.186119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:30.318391 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:30.326863 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:30.328307 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:30.329494 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fad5e1b3-32c5-492d-b615-64d4d0bfe7a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.156062 Aug 01 14:12:30.330057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 272/541] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:30 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:31.054942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-682c5952-49a9-4661-a22c-50b302bd2393 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:31.055550 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-682c5952-49a9-4661-a22c-50b302bd2393 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:31.062435 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-682c5952-49a9-4661-a22c-50b302bd2393 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:31.062886 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-682c5952-49a9-4661-a22c-50b302bd2393 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:31.063649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-682c5952-49a9-4661-a22c-50b302bd2393 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:31.064093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-682c5952-49a9-4661-a22c-50b302bd2393 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:31.191948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-682c5952-49a9-4661-a22c-50b302bd2393 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:31.199431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-682c5952-49a9-4661-a22c-50b302bd2393 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.148401 Aug 01 14:12:31.199995 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 270/542] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:31 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:31.352964 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:31.353510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:31.360575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:31.361027 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:31.361801 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:31.362244 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:31.490591 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:31.498468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:31.499981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:31.501168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d1219bb5-8a81-4256-836f-8302d8ab1f39 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.152299 Aug 01 14:12:31.501732 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 273/543] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:31 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:32.219940 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-706f866e-04da-4b78-8423-3a0c3d34a6d9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:32.220605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-706f866e-04da-4b78-8423-3a0c3d34a6d9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:32.226647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-706f866e-04da-4b78-8423-3a0c3d34a6d9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:32.227093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-706f866e-04da-4b78-8423-3a0c3d34a6d9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:32.227873 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-706f866e-04da-4b78-8423-3a0c3d34a6d9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:32.228307 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-706f866e-04da-4b78-8423-3a0c3d34a6d9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:32.358793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-706f866e-04da-4b78-8423-3a0c3d34a6d9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:32.366244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-706f866e-04da-4b78-8423-3a0c3d34a6d9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.150087 Aug 01 14:12:32.366761 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 271/544] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:32 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:32.523045 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:32.523652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:32.530094 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:32.530543 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:32.531335 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:32.531770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:32.690894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:32.698898 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:32.700411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:32.701586 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-58b00f5e-0f39-4b96-853e-8c9f45753da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.182435 Aug 01 14:12:32.702145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 274/545] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:32 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:33.387685 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0968fd93-66d6-425a-bb84-a6fc6eaa9175 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:33.388301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0968fd93-66d6-425a-bb84-a6fc6eaa9175 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:33.394492 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0968fd93-66d6-425a-bb84-a6fc6eaa9175 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:33.394941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0968fd93-66d6-425a-bb84-a6fc6eaa9175 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:33.395709 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0968fd93-66d6-425a-bb84-a6fc6eaa9175 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:33.396168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0968fd93-66d6-425a-bb84-a6fc6eaa9175 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:33.411237 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:33.532526 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0968fd93-66d6-425a-bb84-a6fc6eaa9175 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:33.540817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0968fd93-66d6-425a-bb84-a6fc6eaa9175 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.156959 Aug 01 14:12:33.541384 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 272/546] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:33 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:33.614171 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d5c7e19d-d67c-42e1-920f-060f2ca4c194 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:33.614671 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d5c7e19d-d67c-42e1-920f-060f2ca4c194 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:33.621824 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5c7e19d-d67c-42e1-920f-060f2ca4c194 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:33.622277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5c7e19d-d67c-42e1-920f-060f2ca4c194 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:33.623055 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5c7e19d-d67c-42e1-920f-060f2ca4c194 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:33.623498 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5c7e19d-d67c-42e1-920f-060f2ca4c194 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:33.646022 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d5c7e19d-d67c-42e1-920f-060f2ca4c194 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/ips" status: 200 len: 149 microversion: 2.1 time: 0.035981 Aug 01 14:12:33.646587 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 275/547] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:12:33 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:33.724285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:33.724938 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:33.731787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:33.732275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:33.733079 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:33.733526 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:33.870037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:33.878255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:33.879760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:33.881006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0150e722-7cfa-4552-9d3f-f8dfcd894918 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.160527 Aug 01 14:12:33.881587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 273/548] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:33 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:34.563379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-378c000c-d20e-46d0-8cfa-cc31190ccb82 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:34.563920 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-378c000c-d20e-46d0-8cfa-cc31190ccb82 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:34.570172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-378c000c-d20e-46d0-8cfa-cc31190ccb82 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:34.570624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-378c000c-d20e-46d0-8cfa-cc31190ccb82 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:34.571387 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-378c000c-d20e-46d0-8cfa-cc31190ccb82 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:34.571827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-378c000c-d20e-46d0-8cfa-cc31190ccb82 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:34.703987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-378c000c-d20e-46d0-8cfa-cc31190ccb82 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:34.711715 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-378c000c-d20e-46d0-8cfa-cc31190ccb82 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.152426 Aug 01 14:12:34.712276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 276/549] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:34 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:34.903054 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:34.903667 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:34.909770 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:34.910214 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:34.910968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:34.911402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:35.022324 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0cc97123-d4dd-445d-908b-6b5aa3087bec tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "923506b4-7235-4385-ae97-bc61fac6ad40"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:35.024732 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0cc97123-d4dd-445d-908b-6b5aa3087bec tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:35.030738 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0cc97123-d4dd-445d-908b-6b5aa3087bec tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:35.031182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0cc97123-d4dd-445d-908b-6b5aa3087bec tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:35.031937 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0cc97123-d4dd-445d-908b-6b5aa3087bec tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:35.032368 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0cc97123-d4dd-445d-908b-6b5aa3087bec tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:35.045115 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:35.053731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:35.055386 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:35.056697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-33aca1ac-333a-4cd4-a5d1-9ae4a4d2d166 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.157485 Aug 01 14:12:35.057951 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 274/550] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:34 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:35.348227 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0cc97123-d4dd-445d-908b-6b5aa3087bec tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329915 Aug 01 14:12:35.348949 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 277/551] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:12:35 2022] POST /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:12:35.732214 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-15a38298-8c0d-43ba-9666-d7f25cf07490 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:35.733276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-15a38298-8c0d-43ba-9666-d7f25cf07490 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:35.739213 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15a38298-8c0d-43ba-9666-d7f25cf07490 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:35.739666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15a38298-8c0d-43ba-9666-d7f25cf07490 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:35.740432 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15a38298-8c0d-43ba-9666-d7f25cf07490 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:35.740896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15a38298-8c0d-43ba-9666-d7f25cf07490 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:35.875983 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-15a38298-8c0d-43ba-9666-d7f25cf07490 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:35.883392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-15a38298-8c0d-43ba-9666-d7f25cf07490 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.154974 Aug 01 14:12:35.884467 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 275/552] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:35 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:36.083770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:36.084764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:36.091451 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:36.091898 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:36.092688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:36.093129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:36.224374 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:36.232783 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:36.234310 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:36.235525 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b917d773-3721-4c18-8a02-3bbb1415ca9a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1746 microversion: 2.20 time: 0.156032 Aug 01 14:12:36.236044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 278/553] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:36 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:36.498505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-24720d2c-5702-4731-b33f-f3671d792ddf tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:36.499001 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-24720d2c-5702-4731-b33f-f3671d792ddf tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:36.504995 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24720d2c-5702-4731-b33f-f3671d792ddf tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:36.505441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24720d2c-5702-4731-b33f-f3671d792ddf tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:36.506201 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24720d2c-5702-4731-b33f-f3671d792ddf tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:36.506634 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24720d2c-5702-4731-b33f-f3671d792ddf tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:36.632173 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-24720d2c-5702-4731-b33f-f3671d792ddf tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lazy-loading 'services' on Instance uuid f5922be0-946e-4dff-b598-80a7ff1433d3 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:12:36.745194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-24720d2c-5702-4731-b33f-f3671d792ddf tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3/os-volume_attachments/7a94aeb3-5058-4514-a7a0-5a001927948c" status: 202 len: 0 microversion: 2.1 time: 0.251015 Aug 01 14:12:36.745796 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 276/554] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:12:36 2022] DELETE /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3/os-volume_attachments/7a94aeb3-5058-4514-a7a0-5a001927948c => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:12:36.905983 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f9d9c8a8-12ac-477d-82e5-52fdda914297 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:36.906592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f9d9c8a8-12ac-477d-82e5-52fdda914297 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:36.913085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f9d9c8a8-12ac-477d-82e5-52fdda914297 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:36.913534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f9d9c8a8-12ac-477d-82e5-52fdda914297 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:36.914316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f9d9c8a8-12ac-477d-82e5-52fdda914297 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:36.914750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f9d9c8a8-12ac-477d-82e5-52fdda914297 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.047798 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f9d9c8a8-12ac-477d-82e5-52fdda914297 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:37.055366 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f9d9c8a8-12ac-477d-82e5-52fdda914297 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.153139 Aug 01 14:12:37.055935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 279/555] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:36 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:37.261756 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:37.262362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:37.268518 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.268984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.269706 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.270132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.405262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:37.413041 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:37.414526 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:37.415656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2392682b-3396-4e3a-979e-29515ede4b15 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1746 microversion: 2.20 time: 0.158720 Aug 01 14:12:37.416210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 277/556] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:37 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1746 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:37.882689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-7142c2b8-1546-4239-8302-b24ddb9e7cd7 req-32c782c0-31f1-4be3-955a-b335a3a3f166 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fd7ad6-9939-4561-b0fa-f45f8602eccf", "name": "network-vif-plugged", "status": "completed", "tag": "74f5404a-20d0-4b4a-8fec-5f4dbc58380a"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:37.893550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-7142c2b8-1546-4239-8302-b24ddb9e7cd7 req-32c782c0-31f1-4be3-955a-b335a3a3f166 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:37.894087 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-7142c2b8-1546-4239-8302-b24ddb9e7cd7 req-32c782c0-31f1-4be3-955a-b335a3a3f166 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:37.906745 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-7142c2b8-1546-4239-8302-b24ddb9e7cd7 req-32c782c0-31f1-4be3-955a-b335a3a3f166 service nova] Creating event network-vif-plugged:74f5404a-20d0-4b4a-8fec-5f4dbc58380a for instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf on hv-cinder-84713 Aug 01 14:12:37.911479 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-7142c2b8-1546-4239-8302-b24ddb9e7cd7 req-32c782c0-31f1-4be3-955a-b335a3a3f166 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032423 Aug 01 14:12:37.912054 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 280/557] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:38.075411 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4158642b-9223-4d34-963f-09a9e0e419e0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:38.075951 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4158642b-9223-4d34-963f-09a9e0e419e0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:38.082042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4158642b-9223-4d34-963f-09a9e0e419e0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:38.082493 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4158642b-9223-4d34-963f-09a9e0e419e0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:38.083254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4158642b-9223-4d34-963f-09a9e0e419e0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:38.083691 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4158642b-9223-4d34-963f-09a9e0e419e0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:38.212621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4158642b-9223-4d34-963f-09a9e0e419e0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:38.220151 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4158642b-9223-4d34-963f-09a9e0e419e0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.148903 Aug 01 14:12:38.220751 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 278/558] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:38 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:38.439486 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:38.440182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:38.446386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:38.446834 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:38.448240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:38.448726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:38.577634 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:38.585815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:38.587315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:38.588451 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f25c2436-9c0e-4d25-a905-3b0bd3c953c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1746 microversion: 2.20 time: 0.153219 Aug 01 14:12:38.589031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 281/559] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:38 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1746 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:39.241358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-55ed44d7-7462-4c01-ae3f-56bd79196ec5 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:39.241969 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-55ed44d7-7462-4c01-ae3f-56bd79196ec5 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:39.248075 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55ed44d7-7462-4c01-ae3f-56bd79196ec5 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:39.248590 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55ed44d7-7462-4c01-ae3f-56bd79196ec5 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:39.249353 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55ed44d7-7462-4c01-ae3f-56bd79196ec5 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:39.249793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-55ed44d7-7462-4c01-ae3f-56bd79196ec5 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:39.379222 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-55ed44d7-7462-4c01-ae3f-56bd79196ec5 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:39.387228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-55ed44d7-7462-4c01-ae3f-56bd79196ec5 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.150110 Aug 01 14:12:39.387786 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 279/560] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:39 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:39.609884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:39.610489 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:39.616951 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:39.617680 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:39.618140 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:39.618572 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:39.747734 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:39.755520 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:39.757045 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:39.758176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-20aa7b7f-1f7a-40ce-b98d-cf12d66b593e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1746 microversion: 2.20 time: 0.152145 Aug 01 14:12:39.758735 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 282/561] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:39 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:40.407394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-df7ee8aa-5074-4240-9748-5e4e2a360da0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:40.407995 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-df7ee8aa-5074-4240-9748-5e4e2a360da0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:40.413927 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df7ee8aa-5074-4240-9748-5e4e2a360da0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:40.414366 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df7ee8aa-5074-4240-9748-5e4e2a360da0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:40.415116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df7ee8aa-5074-4240-9748-5e4e2a360da0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:40.415549 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df7ee8aa-5074-4240-9748-5e4e2a360da0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:40.548921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-df7ee8aa-5074-4240-9748-5e4e2a360da0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:40.556288 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-df7ee8aa-5074-4240-9748-5e4e2a360da0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.152677 Aug 01 14:12:40.556913 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 280/562] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:40 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:40.781384 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:40.781995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:40.788501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:40.788969 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:40.789726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:40.790163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:40.918946 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:40.926716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:40.928207 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:40.929379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0adc999c-2332-4749-ba99-f91b6a6fadf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1746 microversion: 2.20 time: 0.151857 Aug 01 14:12:40.929933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 283/563] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:40 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1746 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:41.577113 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-30fff8d2-de61-48cb-b7cb-74101f1234c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:41.577720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-30fff8d2-de61-48cb-b7cb-74101f1234c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:41.583796 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30fff8d2-de61-48cb-b7cb-74101f1234c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:41.584521 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30fff8d2-de61-48cb-b7cb-74101f1234c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:41.585284 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30fff8d2-de61-48cb-b7cb-74101f1234c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:41.585720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30fff8d2-de61-48cb-b7cb-74101f1234c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:41.712764 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-30fff8d2-de61-48cb-b7cb-74101f1234c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:41.721390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-30fff8d2-de61-48cb-b7cb-74101f1234c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.147988 Aug 01 14:12:41.722162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 281/564] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:41 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:41.952297 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:41.952958 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:41.959771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:41.960225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:41.961022 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:41.961463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:41.966014 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:42.097060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:42.106069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:42.107575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:42.108770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-29c7f371-0e45-42cd-894a-ae2f489f8bf1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1746 microversion: 2.20 time: 0.160291 Aug 01 14:12:42.109331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 284/565] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:41 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1746 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:42.742582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-76a60ebf-2f09-423c-8229-8b3e9ee6479a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:42.743125 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-76a60ebf-2f09-423c-8229-8b3e9ee6479a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:42.749795 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76a60ebf-2f09-423c-8229-8b3e9ee6479a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:42.750244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76a60ebf-2f09-423c-8229-8b3e9ee6479a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:42.751303 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76a60ebf-2f09-423c-8229-8b3e9ee6479a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:42.751740 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76a60ebf-2f09-423c-8229-8b3e9ee6479a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:42.891014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-76a60ebf-2f09-423c-8229-8b3e9ee6479a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:42.898434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-76a60ebf-2f09-423c-8229-8b3e9ee6479a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.159769 Aug 01 14:12:42.899003 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 282/566] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:42 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:43.132299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:43.133306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:43.141369 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.141674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:43.142459 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.143015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:43.233208 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ddba8d6d-1405-43e9-bd0c-150ca60a6721 req-3eb51e40-0bd7-48c1-a4e0-d8f1c1a953a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0c5482-0e86-4a38-8b7e-69b2e4def9e5", "name": "network-vif-plugged", "status": "completed", "tag": "0adf5e77-fe49-401a-95b7-2047d19a841b"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:43.243561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ddba8d6d-1405-43e9-bd0c-150ca60a6721 req-3eb51e40-0bd7-48c1-a4e0-d8f1c1a953a1 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.244605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ddba8d6d-1405-43e9-bd0c-150ca60a6721 req-3eb51e40-0bd7-48c1-a4e0-d8f1c1a953a1 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:43.256357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ddba8d6d-1405-43e9-bd0c-150ca60a6721 req-3eb51e40-0bd7-48c1-a4e0-d8f1c1a953a1 service nova] Creating event network-vif-plugged:0adf5e77-fe49-401a-95b7-2047d19a841b for instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 on hv-cinder-84713 Aug 01 14:12:43.261256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ddba8d6d-1405-43e9-bd0c-150ca60a6721 req-3eb51e40-0bd7-48c1-a4e0-d8f1c1a953a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031728 Aug 01 14:12:43.261853 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 283/567] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:43.289687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:43.298598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:43.300100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:43.301290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8bd8796a-adac-4506-912b-9a16b5db9030 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1746 microversion: 2.20 time: 0.173106 Aug 01 14:12:43.301844 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 285/568] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:43 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:43.919501 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f79d2f06-1b18-48b2-8eaa-8ef19daeca36 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:43.920197 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f79d2f06-1b18-48b2-8eaa-8ef19daeca36 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:43.926326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f79d2f06-1b18-48b2-8eaa-8ef19daeca36 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.926770 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f79d2f06-1b18-48b2-8eaa-8ef19daeca36 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:43.927526 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f79d2f06-1b18-48b2-8eaa-8ef19daeca36 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:43.927954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f79d2f06-1b18-48b2-8eaa-8ef19daeca36 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:43.956509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ba42ea6a-e39c-492c-82f1-fe07a1d958c1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: .version_select at 0x7f4462e4faf0>, body: {"keypair": {"name": "tempest-keypair-1875564812", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfWamFMNh/2LlCd7u2uTlnn4b34d11/c3YY6/4e5Bc/82ysZjFrTjnOR72HRjnWqdCJFiLL/RsG4nMBJrQqzcUKRYx7tH7ImVuUHZlsSN1xWdj0FNiGikg6lnIP9B3nAg=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:43.995259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-ba42ea6a-e39c-492c-82f1-fe07a1d958c1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for project a3203f080a05422e83090a1f0a31d1a9. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:12:43.999917 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-ba42ea6a-e39c-492c-82f1-fe07a1d958c1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for user ca3cd1c2aec94b43aff0034b812a069d and project a3203f080a05422e83090a1f0a31d1a9. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:12:44.027359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ba42ea6a-e39c-492c-82f1-fe07a1d958c1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074556 Aug 01 14:12:44.028181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 286/569] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:12:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:44.064366 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f79d2f06-1b18-48b2-8eaa-8ef19daeca36 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:44.072793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f79d2f06-1b18-48b2-8eaa-8ef19daeca36 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.156757 Aug 01 14:12:44.073384 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 284/570] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:43 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:44.324290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:44.325035 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:44.333243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:44.333701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:44.334718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:44.335363 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:44.528088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:44.536339 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:44.537896 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:44.539075 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-81795883-be15-4f09-a5be-0e66bc72b55f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1746 microversion: 2.20 time: 0.218805 Aug 01 14:12:44.539986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 287/571] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:44 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1746 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:45.094728 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8a9414fa-e1c7-4750-ac79-00c21f679ce3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:45.095348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8a9414fa-e1c7-4750-ac79-00c21f679ce3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:45.102077 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9414fa-e1c7-4750-ac79-00c21f679ce3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.102532 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9414fa-e1c7-4750-ac79-00c21f679ce3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.103900 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9414fa-e1c7-4750-ac79-00c21f679ce3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.104345 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9414fa-e1c7-4750-ac79-00c21f679ce3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.249068 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8a9414fa-e1c7-4750-ac79-00c21f679ce3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.257032 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8a9414fa-e1c7-4750-ac79-00c21f679ce3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.166184 Aug 01 14:12:45.268787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 285/572] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:45 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:45.331721 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9be6927b-c444-425a-8642-a386304ed7a7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:45.332207 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9be6927b-c444-425a-8642-a386304ed7a7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:45.339037 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9be6927b-c444-425a-8642-a386304ed7a7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.339519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9be6927b-c444-425a-8642-a386304ed7a7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.340287 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9be6927b-c444-425a-8642-a386304ed7a7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.340742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9be6927b-c444-425a-8642-a386304ed7a7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.367030 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9be6927b-c444-425a-8642-a386304ed7a7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:12:45.448574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9be6927b-c444-425a-8642-a386304ed7a7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 204 len: 0 microversion: 2.1 time: 0.119589 Aug 01 14:12:45.449413 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 288/573] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:12:45 2022] DELETE /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:12:45.457416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-24553d0e-0e26-4226-9e37-0304ddbee38f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:45.458259 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-24553d0e-0e26-4226-9e37-0304ddbee38f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:45.465765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24553d0e-0e26-4226-9e37-0304ddbee38f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.466436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24553d0e-0e26-4226-9e37-0304ddbee38f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.468116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24553d0e-0e26-4226-9e37-0304ddbee38f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.468769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-24553d0e-0e26-4226-9e37-0304ddbee38f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.504320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-351660084", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "953311ac-9b59-429f-b3be-74acb6dca2d9"}], "security_groups": [{"name": "tempest-securitygroup--1077834851"}], "key_name": "tempest-keypair-1875564812", "user_data": "}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:45.616050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-24553d0e-0e26-4226-9e37-0304ddbee38f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.628386 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-24553d0e-0e26-4226-9e37-0304ddbee38f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1511 microversion: 2.1 time: 0.174295 Aug 01 14:12:45.629414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 286/574] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:45 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1511 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:45.635423 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:45.636958 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:45.643600 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.644048 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.644857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:45.645292 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:45.791268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.799566 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.801103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:45.802263 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-af5cd9b9-c9aa-411c-ae1a-d81991cc7ca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.171594 Aug 01 14:12:45.802817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 287/575] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:45 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:45.880455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] validate_networks() for [('953311ac-9b59-429f-b3be-74acb6dca2d9', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:12:46.257462 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:12:46.257891 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:12:46.258371 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:12:46.258989 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:12:46.259394 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:12:46.269009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.269461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.270293 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.270733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.279061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8beda996-b138-45cd-aff5-45d836fbcdf1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:46.279755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8beda996-b138-45cd-aff5-45d836fbcdf1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:46.285728 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8beda996-b138-45cd-aff5-45d836fbcdf1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.286172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8beda996-b138-45cd-aff5-45d836fbcdf1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.286943 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8beda996-b138-45cd-aff5-45d836fbcdf1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.287377 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8beda996-b138-45cd-aff5-45d836fbcdf1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.289470 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for project a3203f080a05422e83090a1f0a31d1a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:12:46.294131 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for user ca3cd1c2aec94b43aff0034b812a069d and project a3203f080a05422e83090a1f0a31d1a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:12:46.307045 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:12:46.309476 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:12:46.360250 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6a8911e1-abc1-49d1-adf9-3f0c14e9c98c tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.858892 Aug 01 14:12:46.360250 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 289/576] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:12:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:12:46.371357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0b753e9f-6670-4cfc-a268-3332ecff21a1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:46.371977 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0b753e9f-6670-4cfc-a268-3332ecff21a1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:46.434224 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0b753e9f-6670-4cfc-a268-3332ecff21a1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.438645 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8beda996-b138-45cd-aff5-45d836fbcdf1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.443004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0b753e9f-6670-4cfc-a268-3332ecff21a1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1241 microversion: 2.1 time: 0.075966 Aug 01 14:12:46.444862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 290/577] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:46 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:46.448757 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8beda996-b138-45cd-aff5-45d836fbcdf1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1265 microversion: 2.1 time: 0.173238 Aug 01 14:12:46.449324 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 288/578] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:46 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:46.652054 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d2cd1525-80e8-426b-a932-64845ecb3ee8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:46.652813 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d2cd1525-80e8-426b-a932-64845ecb3ee8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:46.659571 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2cd1525-80e8-426b-a932-64845ecb3ee8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.660023 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2cd1525-80e8-426b-a932-64845ecb3ee8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.661008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2cd1525-80e8-426b-a932-64845ecb3ee8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.661447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2cd1525-80e8-426b-a932-64845ecb3ee8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.804220 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d2cd1525-80e8-426b-a932-64845ecb3ee8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.813467 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d2cd1525-80e8-426b-a932-64845ecb3ee8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1511 microversion: 2.1 time: 0.165705 Aug 01 14:12:46.814034 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 291/579] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:46 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:46.827279 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:46.827968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:46.834419 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.834866 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.835632 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:46.836064 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:46.840738 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:46.969747 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.977656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.979164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:46.980312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-381ba487-ea11-4c0a-aa8e-e72eab020e0f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.157109 Aug 01 14:12:46.980901 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 289/580] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:46 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:47.463993 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-81df1ec8-bdc6-4b34-b42f-822df6e22fb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:47.464625 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-81df1ec8-bdc6-4b34-b42f-822df6e22fb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:47.469759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-16ad103c-bbda-4655-9ed0-6644422581dd tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:47.470413 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-16ad103c-bbda-4655-9ed0-6644422581dd tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:47.471100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81df1ec8-bdc6-4b34-b42f-822df6e22fb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.471543 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81df1ec8-bdc6-4b34-b42f-822df6e22fb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.472308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81df1ec8-bdc6-4b34-b42f-822df6e22fb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.472766 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81df1ec8-bdc6-4b34-b42f-822df6e22fb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.477803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16ad103c-bbda-4655-9ed0-6644422581dd tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.477803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16ad103c-bbda-4655-9ed0-6644422581dd tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.477803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16ad103c-bbda-4655-9ed0-6644422581dd tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.478162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16ad103c-bbda-4655-9ed0-6644422581dd tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.537878 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-81df1ec8-bdc6-4b34-b42f-822df6e22fb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:47.545406 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-81df1ec8-bdc6-4b34-b42f-822df6e22fb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1237 microversion: 2.1 time: 0.085931 Aug 01 14:12:47.546277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 292/581] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:47 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1237 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:47.608201 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-16ad103c-bbda-4655-9ed0-6644422581dd tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:47.615725 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-16ad103c-bbda-4655-9ed0-6644422581dd tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1451 microversion: 2.1 time: 0.149975 Aug 01 14:12:47.616288 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 290/582] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:47 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:47.637713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c7643e7b-64fe-4ca1-8821-73c145dc786c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:47.638331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c7643e7b-64fe-4ca1-8821-73c145dc786c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:47.644432 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c7643e7b-64fe-4ca1-8821-73c145dc786c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.644923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c7643e7b-64fe-4ca1-8821-73c145dc786c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.645687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c7643e7b-64fe-4ca1-8821-73c145dc786c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.646130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c7643e7b-64fe-4ca1-8821-73c145dc786c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.782275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c7643e7b-64fe-4ca1-8821-73c145dc786c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:47.789672 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c7643e7b-64fe-4ca1-8821-73c145dc786c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1451 microversion: 2.1 time: 0.156347 Aug 01 14:12:47.790237 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 293/583] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:47 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:47.836189 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-28f51d08-4435-4dbb-a964-2a625d02ff1c tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:47.837084 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-28f51d08-4435-4dbb-a964-2a625d02ff1c tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:47.843848 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28f51d08-4435-4dbb-a964-2a625d02ff1c tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.844294 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28f51d08-4435-4dbb-a964-2a625d02ff1c tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.845147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28f51d08-4435-4dbb-a964-2a625d02ff1c tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:47.845580 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28f51d08-4435-4dbb-a964-2a625d02ff1c tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:47.991091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-28f51d08-4435-4dbb-a964-2a625d02ff1c tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:47.999806 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-28f51d08-4435-4dbb-a964-2a625d02ff1c tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1511 microversion: 2.1 time: 0.168109 Aug 01 14:12:48.000645 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 291/584] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:47 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:48.003291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:48.004012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:48.012892 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:48.013345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:48.014129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:48.015100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:48.274332 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:48.282778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:48.284292 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:48.285486 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3e808ee9-4f9d-4e2c-aa19-32f740bfc095 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.286541 Aug 01 14:12:48.286373 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 294/585] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:47 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:12:48.567904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cdb4887f-f952-4684-a910-9509f125c794 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:48.569308 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cdb4887f-f952-4684-a910-9509f125c794 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:48.582776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cdb4887f-f952-4684-a910-9509f125c794 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:48.583556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cdb4887f-f952-4684-a910-9509f125c794 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:48.584792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cdb4887f-f952-4684-a910-9509f125c794 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:48.586022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cdb4887f-f952-4684-a910-9509f125c794 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:48.684553 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cdb4887f-f952-4684-a910-9509f125c794 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:48.703601 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cdb4887f-f952-4684-a910-9509f125c794 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1301 microversion: 2.1 time: 0.139017 Aug 01 14:12:48.716515 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 292/586] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:48 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1301 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:49.024592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-74668f22-de86-4ba9-8d55-641050ff4ff4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:49.025392 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-74668f22-de86-4ba9-8d55-641050ff4ff4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:49.031870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-74668f22-de86-4ba9-8d55-641050ff4ff4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.032346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-74668f22-de86-4ba9-8d55-641050ff4ff4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.033283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-74668f22-de86-4ba9-8d55-641050ff4ff4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.033847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-74668f22-de86-4ba9-8d55-641050ff4ff4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.310406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:49.311449 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:49.314737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=66 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:49.338478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.338929 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.339711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.340525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.460905 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-74668f22-de86-4ba9-8d55-641050ff4ff4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.485240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-74668f22-de86-4ba9-8d55-641050ff4ff4 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 200 len: 1511 microversion: 2.1 time: 0.464769 Aug 01 14:12:49.486403 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 295/587] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:49 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 1511 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:49.493854 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-8c615b1b-1eef-4404-b646-0ad369465b7d req-aa781df0-2f7a-4b3f-b244-f2a22c0e3f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5922be0-946e-4dff-b598-80a7ff1433d3", "name": "network-vif-deleted", "tag": "20f75126-d096-4a15-ba80-92b6596dcd7c"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:49.507429 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-8c615b1b-1eef-4404-b646-0ad369465b7d req-aa781df0-2f7a-4b3f-b244-f2a22c0e3f16 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.508042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-8c615b1b-1eef-4404-b646-0ad369465b7d req-aa781df0-2f7a-4b3f-b244-f2a22c0e3f16 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.525910 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-8c615b1b-1eef-4404-b646-0ad369465b7d req-aa781df0-2f7a-4b3f-b244-f2a22c0e3f16 service nova] Creating event network-vif-deleted:20f75126-d096-4a15-ba80-92b6596dcd7c for instance f5922be0-946e-4dff-b598-80a7ff1433d3 on hv-cinder-84713 Aug 01 14:12:49.534574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-8c615b1b-1eef-4404-b646-0ad369465b7d req-aa781df0-2f7a-4b3f-b244-f2a22c0e3f16 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045645 Aug 01 14:12:49.536546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 296/588] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:49.610044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.621928 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.623444 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.624638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e1ce518c-34b4-49ba-a4ff-475dacd97680 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.319069 Aug 01 14:12:49.645505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 293/589] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:49 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:49.725648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-85f07357-7c86-4c87-ace4-26751fcc11af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:49.726362 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-85f07357-7c86-4c87-ace4-26751fcc11af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:49.738912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-85f07357-7c86-4c87-ace4-26751fcc11af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.739607 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-85f07357-7c86-4c87-ace4-26751fcc11af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.740610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-85f07357-7c86-4c87-ace4-26751fcc11af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:49.741159 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-85f07357-7c86-4c87-ace4-26751fcc11af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:49.864997 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-85f07357-7c86-4c87-ace4-26751fcc11af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:49.878241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-85f07357-7c86-4c87-ace4-26751fcc11af tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1299 microversion: 2.1 time: 0.155952 Aug 01 14:12:49.878241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 297/590] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:49 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:50.509819 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:50.512293 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: f5922be0-946e-4dff-b598-80a7ff1433d3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:50.531433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.537921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.543025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.543484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.594122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] HTTP exception thrown: Instance f5922be0-946e-4dff-b598-80a7ff1433d3 could not be found. Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Request method failure captured: Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 HTTP/1.1 Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi597zY6gCgxTsmn4TtMDoHDNqAK7IYB7tj8rgBrRwjCeUwTpeauguJcm1pS2K7NQtqt1QtKyajfoqv8jNN4IQ6sDfwl-3GSCSMQPUT5Q2Gp-Xv4YN4qNzw0-Yz37KmzM_qNQK8YRNM0spF6dPFp1Im92u7jfRWTc3JqLAB1od2U7_PRA Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 99a2e6e5b9974029a065bd70058dc8be Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1809679751 Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:12:50.596727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/99a2e6e5b9974029a065bd70058dc8be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/99a2e6e5b9974029a065bd70058dc8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_99a2e6e5b9974029a065bd70058dc8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/99a2e6e5b9974029a065bd70058dc8be"}]}] Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotTestJSON-1809679751 Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 99a2e6e5b9974029a065bd70058dc8be Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1809679751 Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotTestJSON-1809679751-project Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 1d54f339d88a4f8c9ef914497ce3138d Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotTestJSON-1809679751-project Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance f5922be0-946e-4dff-b598-80a7ff1433d3 could not be found. Aug 01 14:12:50.598172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'f5922be0-946e-4dff-b598-80a7ff1433d3'} Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5922be0-946e-4dff-b598-80a7ff1433d3 could not be found. Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:12:50.598997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5922be0-946e-4dff-b598-80a7ff1433d3 could not be found. Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5922be0-946e-4dff-b598-80a7ff1433d3 could not be found. Aug 01 14:12:50.600193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:12:50.607187 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Returning 404 to user: Instance f5922be0-946e-4dff-b598-80a7ff1433d3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:12:50.608065 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3a9772b3-3643-4e69-a4b8-8e142b3ef99a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3" status: 404 len: 111 microversion: 2.1 time: 0.104066 Aug 01 14:12:50.612426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 294/591] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:50 2022] GET /compute/v2.1/servers/f5922be0-946e-4dff-b598-80a7ff1433d3 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:12:50.653216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:50.654141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:50.657779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:50.687723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.688661 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.690019 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.691533 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.898798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ce08626d-b026-4749-8af6-cc294657d2b1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:50.900520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ce08626d-b026-4749-8af6-cc294657d2b1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:50.911443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce08626d-b026-4749-8af6-cc294657d2b1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.914310 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce08626d-b026-4749-8af6-cc294657d2b1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.917489 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce08626d-b026-4749-8af6-cc294657d2b1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:50.919885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce08626d-b026-4749-8af6-cc294657d2b1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:50.944713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:50.954915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:50.956919 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:50.960452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-52d50c0a-ca2e-42dd-b601-6083a6dc75c7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.311670 Aug 01 14:12:50.961781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 298/592] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:50 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:51.046456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-2f81a609-f920-4542-a158-e6c61045a3e4 req-fc261cff-255e-46bf-972f-98343218d438 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98847e8e-92b8-46b9-bb66-3b374c9a81b0", "tag": "b94eab45-df8a-46b1-8ac7-6a080ffcb4e7"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:51.065869 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-2f81a609-f920-4542-a158-e6c61045a3e4 req-fc261cff-255e-46bf-972f-98343218d438 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:51.066452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-2f81a609-f920-4542-a158-e6c61045a3e4 req-fc261cff-255e-46bf-972f-98343218d438 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:51.091760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-2f81a609-f920-4542-a158-e6c61045a3e4 req-fc261cff-255e-46bf-972f-98343218d438 service nova] Creating event network-changed:b94eab45-df8a-46b1-8ac7-6a080ffcb4e7 for instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 on hv-cinder-84713 Aug 01 14:12:51.097332 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-2f81a609-f920-4542-a158-e6c61045a3e4 req-fc261cff-255e-46bf-972f-98343218d438 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057181 Aug 01 14:12:51.097917 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 299/593] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:51.261054 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce08626d-b026-4749-8af6-cc294657d2b1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:51.272049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ce08626d-b026-4749-8af6-cc294657d2b1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.377917 Aug 01 14:12:51.273069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 295/594] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:50 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:12:51.564941 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-ab8020b0-4b5c-47a4-bd5d-beae44ff6e3e req-e9ce188c-d4a4-45e2-9788-6864bfa07014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0c5482-0e86-4a38-8b7e-69b2e4def9e5", "tag": "0adf5e77-fe49-401a-95b7-2047d19a841b"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:12:51.582261 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-ab8020b0-4b5c-47a4-bd5d-beae44ff6e3e req-e9ce188c-d4a4-45e2-9788-6864bfa07014 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:51.582261 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-ab8020b0-4b5c-47a4-bd5d-beae44ff6e3e req-e9ce188c-d4a4-45e2-9788-6864bfa07014 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:51.599460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-ab8020b0-4b5c-47a4-bd5d-beae44ff6e3e req-e9ce188c-d4a4-45e2-9788-6864bfa07014 service nova] Creating event network-changed:0adf5e77-fe49-401a-95b7-2047d19a841b for instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 on hv-cinder-84713 Aug 01 14:12:51.614368 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-ab8020b0-4b5c-47a4-bd5d-beae44ff6e3e req-e9ce188c-d4a4-45e2-9788-6864bfa07014 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053378 Aug 01 14:12:51.615161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 300/595] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:12:51.990731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:51.991998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:51.998995 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:51.999807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:52.000843 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:52.001488 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:52.167886 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:52.176613 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:52.178373 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:52.179800 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b38bf6c7-bd1b-4815-bd68-6091ebd9f7ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.193035 Aug 01 14:12:52.181453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 296/596] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:51 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:52.306667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d7169096-3d4c-4ff0-a0f1-0a107a96cdc9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:52.306667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d7169096-3d4c-4ff0-a0f1-0a107a96cdc9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:52.314829 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d7169096-3d4c-4ff0-a0f1-0a107a96cdc9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:52.315291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d7169096-3d4c-4ff0-a0f1-0a107a96cdc9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:52.316098 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d7169096-3d4c-4ff0-a0f1-0a107a96cdc9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:52.316564 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d7169096-3d4c-4ff0-a0f1-0a107a96cdc9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:52.498864 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d7169096-3d4c-4ff0-a0f1-0a107a96cdc9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:52.506688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d7169096-3d4c-4ff0-a0f1-0a107a96cdc9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.217121 Aug 01 14:12:52.516196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 301/597] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:52 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:53.211454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:53.212874 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:53.219599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:53.220291 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:53.221318 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:53.221908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:53.378008 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:53.390221 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:53.392641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:53.395202 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c198bb27-5396-47af-a70f-4e39fdcf9ebd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.189021 Aug 01 14:12:53.417239 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 297/598] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:53 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:53.529040 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-13085b2e-681c-46c4-b715-9a4dd3ef97ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:53.530272 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-13085b2e-681c-46c4-b715-9a4dd3ef97ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:53.537442 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-13085b2e-681c-46c4-b715-9a4dd3ef97ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:53.537896 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-13085b2e-681c-46c4-b715-9a4dd3ef97ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:53.539099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-13085b2e-681c-46c4-b715-9a4dd3ef97ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:53.540291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-13085b2e-681c-46c4-b715-9a4dd3ef97ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:53.694149 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-13085b2e-681c-46c4-b715-9a4dd3ef97ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:53.706331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-13085b2e-681c-46c4-b715-9a4dd3ef97ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.182374 Aug 01 14:12:53.710681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 302/599] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:53 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:54.433652 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:54.435428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:54.442741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:54.443183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:54.443950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:54.444379 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:54.598834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:54.607807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:54.609528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:54.610966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e2b7f76a-ed7d-4e04-aa5e-729d11a69e5a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.183169 Aug 01 14:12:54.612101 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 298/600] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:54 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:54.738460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c758fb4b-8cc9-4746-8b2e-2e5f333f6579 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:54.739959 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c758fb4b-8cc9-4746-8b2e-2e5f333f6579 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:54.753710 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c758fb4b-8cc9-4746-8b2e-2e5f333f6579 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:54.754415 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c758fb4b-8cc9-4746-8b2e-2e5f333f6579 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:54.755351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c758fb4b-8cc9-4746-8b2e-2e5f333f6579 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:54.755945 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c758fb4b-8cc9-4746-8b2e-2e5f333f6579 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:54.908781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c758fb4b-8cc9-4746-8b2e-2e5f333f6579 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:54.914644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:54.917901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c758fb4b-8cc9-4746-8b2e-2e5f333f6579 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.188836 Aug 01 14:12:54.918724 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 303/601] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:54 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:55.636047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:55.637572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:55.644505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:55.645026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:55.646051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:55.646714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:55.810564 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:55.825819 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:55.827305 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:55.828728 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6ef136b2-d6df-4c8f-afb2-7e4a3f14b52c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.197272 Aug 01 14:12:55.836560 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 299/602] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:55 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:55.940246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f565ac47-9d4a-48fd-af38-e0cc5a9f4552 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:55.941549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f565ac47-9d4a-48fd-af38-e0cc5a9f4552 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:55.951456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f565ac47-9d4a-48fd-af38-e0cc5a9f4552 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:55.952314 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f565ac47-9d4a-48fd-af38-e0cc5a9f4552 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:55.953278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f565ac47-9d4a-48fd-af38-e0cc5a9f4552 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:55.953785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f565ac47-9d4a-48fd-af38-e0cc5a9f4552 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:56.125635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f565ac47-9d4a-48fd-af38-e0cc5a9f4552 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:56.134695 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f565ac47-9d4a-48fd-af38-e0cc5a9f4552 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.198539 Aug 01 14:12:56.135351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 304/603] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:55 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:56.858243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:56.858960 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:56.865426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:56.866218 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:56.867132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:56.867641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:57.028928 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:57.038189 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:57.039948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:57.041260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ebaf6fe9-68ec-471e-898c-c6eccad225d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.188088 Aug 01 14:12:57.042394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 300/604] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:56 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:57.155485 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4a53d50d-0e78-4151-9dbb-a23ec830509b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:57.156858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4a53d50d-0e78-4151-9dbb-a23ec830509b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:57.158812 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:57.159484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=12 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:57.165572 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4a53d50d-0e78-4151-9dbb-a23ec830509b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:57.166031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4a53d50d-0e78-4151-9dbb-a23ec830509b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:57.166797 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4a53d50d-0e78-4151-9dbb-a23ec830509b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:57.167278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4a53d50d-0e78-4151-9dbb-a23ec830509b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:57.306988 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4a53d50d-0e78-4151-9dbb-a23ec830509b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:57.314492 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4a53d50d-0e78-4151-9dbb-a23ec830509b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.163023 Aug 01 14:12:57.321492 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 305/605] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:57 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:58.066162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:58.067688 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:58.074935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:58.075387 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:58.076180 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:58.076791 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:58.252867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:58.266730 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:58.269796 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:58.271556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1447d996-9655-4f0f-a49a-f9f3612763c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.209620 Aug 01 14:12:58.272517 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 301/606] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:58 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:58.337027 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5a131eb9-e3dc-4f00-89ab-3594e9e4b813 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:58.337704 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5a131eb9-e3dc-4f00-89ab-3594e9e4b813 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:58.344610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5a131eb9-e3dc-4f00-89ab-3594e9e4b813 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:58.345067 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5a131eb9-e3dc-4f00-89ab-3594e9e4b813 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:58.345853 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5a131eb9-e3dc-4f00-89ab-3594e9e4b813 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:58.346306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5a131eb9-e3dc-4f00-89ab-3594e9e4b813 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:58.512318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5a131eb9-e3dc-4f00-89ab-3594e9e4b813 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:58.523152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5a131eb9-e3dc-4f00-89ab-3594e9e4b813 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.190769 Aug 01 14:12:58.524519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 306/607] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:58 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:12:59.299202 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:59.299746 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:59.305755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:59.306194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:59.306942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:59.307370 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:59.432067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:59.439871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:59.441401 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:59.442592 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be0e28ce-175a-42c6-8c98-41210db93d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.147327 Aug 01 14:12:59.443175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 302/608] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:12:59 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:12:59.544670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4da766a8-df01-4a7c-8533-45c4a85842a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:12:59.545378 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4da766a8-df01-4a7c-8533-45c4a85842a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:12:59.551943 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4da766a8-df01-4a7c-8533-45c4a85842a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:59.552332 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4da766a8-df01-4a7c-8533-45c4a85842a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:59.553155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4da766a8-df01-4a7c-8533-45c4a85842a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:12:59.553592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4da766a8-df01-4a7c-8533-45c4a85842a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:12:59.679261 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4da766a8-df01-4a7c-8533-45c4a85842a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:12:59.687152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4da766a8-df01-4a7c-8533-45c4a85842a6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.146441 Aug 01 14:12:59.687724 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 307/609] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:12:59 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:00.465872 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:00.466485 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:00.472505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:00.472979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:00.473742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:00.474177 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:00.609122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:00.617033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:00.619187 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:00.620326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8d3bde9c-167a-4758-b1cb-2523e45297f9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.158393 Aug 01 14:13:00.620922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 303/610] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:00 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:00.707267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7c4617b1-7303-494b-a836-8e060dcca4cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:00.707815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7c4617b1-7303-494b-a836-8e060dcca4cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:00.715229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7c4617b1-7303-494b-a836-8e060dcca4cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:00.715679 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7c4617b1-7303-494b-a836-8e060dcca4cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:00.716440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7c4617b1-7303-494b-a836-8e060dcca4cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:00.716915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7c4617b1-7303-494b-a836-8e060dcca4cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:00.847987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7c4617b1-7303-494b-a836-8e060dcca4cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:00.856052 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7c4617b1-7303-494b-a836-8e060dcca4cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.152704 Aug 01 14:13:00.856718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 308/611] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:00 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:01.643181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:01.643688 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:01.650307 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:01.650745 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:01.651490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:01.651988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:01.779595 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:01.787472 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:01.789011 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:01.790217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d63dc3a0-6cc3-4201-824a-86d74de7ded3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.151058 Aug 01 14:13:01.790773 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 304/612] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:01 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:01.877249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2d56d743-32c1-424e-86e6-93b6b8397f91 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:01.877873 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2d56d743-32c1-424e-86e6-93b6b8397f91 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:01.884804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2d56d743-32c1-424e-86e6-93b6b8397f91 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:01.885254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2d56d743-32c1-424e-86e6-93b6b8397f91 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:01.886012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2d56d743-32c1-424e-86e6-93b6b8397f91 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:01.886447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2d56d743-32c1-424e-86e6-93b6b8397f91 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:02.012660 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2d56d743-32c1-424e-86e6-93b6b8397f91 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:02.020108 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2d56d743-32c1-424e-86e6-93b6b8397f91 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.146721 Aug 01 14:13:02.020692 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 309/613] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:01 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:02.813769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:02.814455 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:02.823109 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:02.823564 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:02.824366 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:02.824855 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:02.953342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1334452913", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "networks": [{"uuid": "cfc563f9-7943-4af8-8703-0d6ce2775d5f"}]}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:02.958373 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:02.967056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:02.968596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:02.969752 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0357fcc0-c137-43ee-a46f-9ea21388230f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.160619 Aug 01 14:13:02.970313 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 305/614] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:02 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:03.008277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] validate_networks() for [('cfc563f9-7943-4af8-8703-0d6ce2775d5f', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:13:03.041435 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-af404845-f39a-41a9-a484-c69c73ec1dee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:03.042052 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-af404845-f39a-41a9-a484-c69c73ec1dee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:03.048380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af404845-f39a-41a9-a484-c69c73ec1dee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:03.048961 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af404845-f39a-41a9-a484-c69c73ec1dee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:03.049794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af404845-f39a-41a9-a484-c69c73ec1dee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:03.050291 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af404845-f39a-41a9-a484-c69c73ec1dee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:03.065910 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:03.186762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-af404845-f39a-41a9-a484-c69c73ec1dee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:03.194345 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-af404845-f39a-41a9-a484-c69c73ec1dee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.156943 Aug 01 14:13:03.194918 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 306/615] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:03 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:03.723788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:13:03.724218 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:13:03.724713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:13:03.725120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:13:03.725530 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:13:03.738577 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:03.739163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:03.741211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:03.741867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:03.759873 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Getting quotas for project 99a2e6e5b9974029a065bd70058dc8be. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:13:03.764643 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Getting quotas for user 1d54f339d88a4f8c9ef914497ce3138d and project 99a2e6e5b9974029a065bd70058dc8be. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:13:03.776315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:13:03.778657 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:13:03.830320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ed102f08-13ce-4762-9a89-a4f4c07a3431 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880496 Aug 01 14:13:03.831200 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 310/616] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:13:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:13:03.842741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f0ab0c9c-b2b2-468e-9abf-b13b22c206ee tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:03.844121 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f0ab0c9c-b2b2-468e-9abf-b13b22c206ee tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:03.947312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f0ab0c9c-b2b2-468e-9abf-b13b22c206ee tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:03.954337 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f0ab0c9c-b2b2-468e-9abf-b13b22c206ee tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1219 microversion: 2.1 time: 0.115273 Aug 01 14:13:03.968611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 307/617] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:03 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1219 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:03.994944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:03.995640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:04.005262 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.005715 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.006494 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.006925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.219106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3e4ce615-2bba-45fe-b1ef-0070cb240ed3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:04.219784 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3e4ce615-2bba-45fe-b1ef-0070cb240ed3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:04.235100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e4ce615-2bba-45fe-b1ef-0070cb240ed3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.237612 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e4ce615-2bba-45fe-b1ef-0070cb240ed3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.239527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e4ce615-2bba-45fe-b1ef-0070cb240ed3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.240142 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3e4ce615-2bba-45fe-b1ef-0070cb240ed3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.240289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:04.250864 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:04.252866 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:04.254361 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-914435dc-8996-4a2a-83db-2fb0e33f1e69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1741 microversion: 2.20 time: 0.265409 Aug 01 14:13:04.270792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 311/618] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:03 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1741 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:04.610977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3e4ce615-2bba-45fe-b1ef-0070cb240ed3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:04.618863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3e4ce615-2bba-45fe-b1ef-0070cb240ed3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.406866 Aug 01 14:13:04.619426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 308/619] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:04 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:04.977330 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d90e1321-79ca-46a8-be22-d5e048813aae tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:04.977944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d90e1321-79ca-46a8-be22-d5e048813aae tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:04.984075 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d90e1321-79ca-46a8-be22-d5e048813aae tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.984560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d90e1321-79ca-46a8-be22-d5e048813aae tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:04.985310 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d90e1321-79ca-46a8-be22-d5e048813aae tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:04.985744 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d90e1321-79ca-46a8-be22-d5e048813aae tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.054618 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d90e1321-79ca-46a8-be22-d5e048813aae tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.062856 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d90e1321-79ca-46a8-be22-d5e048813aae tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1215 microversion: 2.1 time: 0.089984 Aug 01 14:13:05.063424 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 312/620] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:04 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1215 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:05.278666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:05.279297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:05.285335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.285776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.286721 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.287317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.287796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-340955a2-49eb-4296-9f0a-8eaaadefee64 req-4a27cc0b-e074-4003-ba43-bb30f7a23467 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98847e8e-92b8-46b9-bb66-3b374c9a81b0", "name": "network-vif-plugged", "status": "completed", "tag": "b94eab45-df8a-46b1-8ac7-6a080ffcb4e7"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:05.299246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-340955a2-49eb-4296-9f0a-8eaaadefee64 req-4a27cc0b-e074-4003-ba43-bb30f7a23467 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.299944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-340955a2-49eb-4296-9f0a-8eaaadefee64 req-4a27cc0b-e074-4003-ba43-bb30f7a23467 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.314484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-340955a2-49eb-4296-9f0a-8eaaadefee64 req-4a27cc0b-e074-4003-ba43-bb30f7a23467 service nova] Creating event network-vif-plugged:b94eab45-df8a-46b1-8ac7-6a080ffcb4e7 for instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 on hv-cinder-84713 Aug 01 14:13:05.319720 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-340955a2-49eb-4296-9f0a-8eaaadefee64 req-4a27cc0b-e074-4003-ba43-bb30f7a23467 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035905 Aug 01 14:13:05.320419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 313/621] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:05.422236 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.430996 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.432367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.433541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-baf91fb6-0c85-4a52-9f17-919b9d862a32 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1723 microversion: 2.20 time: 0.158979 Aug 01 14:13:05.434104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 309/622] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:05 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:05.640402 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ffe4ba5f-11d9-4973-b09e-a23b825cf4c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:05.641050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ffe4ba5f-11d9-4973-b09e-a23b825cf4c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:05.647294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba5f-11d9-4973-b09e-a23b825cf4c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.647743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba5f-11d9-4973-b09e-a23b825cf4c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.649242 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba5f-11d9-4973-b09e-a23b825cf4c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:05.649684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ffe4ba5f-11d9-4973-b09e-a23b825cf4c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:05.788353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ffe4ba5f-11d9-4973-b09e-a23b825cf4c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:05.796073 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ffe4ba5f-11d9-4973-b09e-a23b825cf4c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.160056 Aug 01 14:13:05.796733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 314/623] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:05 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:06.083434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d02df955-34c0-46ea-acff-eededbc7a782 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:06.084035 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d02df955-34c0-46ea-acff-eededbc7a782 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:06.091133 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d02df955-34c0-46ea-acff-eededbc7a782 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.091585 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d02df955-34c0-46ea-acff-eededbc7a782 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.092356 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d02df955-34c0-46ea-acff-eededbc7a782 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.092816 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d02df955-34c0-46ea-acff-eededbc7a782 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.181605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d02df955-34c0-46ea-acff-eededbc7a782 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.191124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d02df955-34c0-46ea-acff-eededbc7a782 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1279 microversion: 2.1 time: 0.111374 Aug 01 14:13:06.205676 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 310/624] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:06 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1279 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:06.456105 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:06.457013 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:06.463810 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.464263 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.465186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.465697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.603056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.612653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.614256 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:06.615685 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-47c12366-c431-469c-8082-68007a60986c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1723 microversion: 2.20 time: 0.163609 Aug 01 14:13:06.616427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 315/625] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:06 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:06.817402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a3ce9e35-0412-4254-9ffb-a7e7e775891b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:06.818016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a3ce9e35-0412-4254-9ffb-a7e7e775891b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:06.824841 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a3ce9e35-0412-4254-9ffb-a7e7e775891b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.825290 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a3ce9e35-0412-4254-9ffb-a7e7e775891b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:06.826061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a3ce9e35-0412-4254-9ffb-a7e7e775891b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:06.826495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a3ce9e35-0412-4254-9ffb-a7e7e775891b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.036455 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a3ce9e35-0412-4254-9ffb-a7e7e775891b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:07.044427 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a3ce9e35-0412-4254-9ffb-a7e7e775891b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.231039 Aug 01 14:13:07.045027 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 311/626] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:06 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:07.213617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-28009c61-6d7e-4b17-b810-0031cf64e7d9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:07.214231 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-28009c61-6d7e-4b17-b810-0031cf64e7d9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:07.220243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28009c61-6d7e-4b17-b810-0031cf64e7d9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.220727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28009c61-6d7e-4b17-b810-0031cf64e7d9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.221496 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28009c61-6d7e-4b17-b810-0031cf64e7d9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.221935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28009c61-6d7e-4b17-b810-0031cf64e7d9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.346914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-28009c61-6d7e-4b17-b810-0031cf64e7d9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:07.355129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-28009c61-6d7e-4b17-b810-0031cf64e7d9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.145363 Aug 01 14:13:07.355692 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 316/627] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:07 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:07.639980 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:07.640532 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:07.646624 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.647076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.647925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:07.648421 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:07.775120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:07.782869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:07.784375 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:07.785526 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-33eb3cfa-0166-410c-b930-81f5bdcca30b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1723 microversion: 2.20 time: 0.149722 Aug 01 14:13:07.786080 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 312/628] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:07 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:08.065559 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e8d01868-10f2-4241-86b7-9dd608868831 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.066176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e8d01868-10f2-4241-86b7-9dd608868831 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:08.072688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e8d01868-10f2-4241-86b7-9dd608868831 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.073128 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e8d01868-10f2-4241-86b7-9dd608868831 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.073877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e8d01868-10f2-4241-86b7-9dd608868831 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.074306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e8d01868-10f2-4241-86b7-9dd608868831 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.209411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e8d01868-10f2-4241-86b7-9dd608868831 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.217432 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e8d01868-10f2-4241-86b7-9dd608868831 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.155751 Aug 01 14:13:08.217997 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 317/629] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:08 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:08.375216 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2342522c-9f01-45f6-bd8a-8876dc5a0d1e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.375764 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2342522c-9f01-45f6-bd8a-8876dc5a0d1e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:08.381824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2342522c-9f01-45f6-bd8a-8876dc5a0d1e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.382274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2342522c-9f01-45f6-bd8a-8876dc5a0d1e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.383036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2342522c-9f01-45f6-bd8a-8876dc5a0d1e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.383474 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2342522c-9f01-45f6-bd8a-8876dc5a0d1e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.509898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2342522c-9f01-45f6-bd8a-8876dc5a0d1e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.517271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2342522c-9f01-45f6-bd8a-8876dc5a0d1e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.146022 Aug 01 14:13:08.517839 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 313/630] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:08 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:08.808875 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:08.809523 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:08.815768 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.816223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.817031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:08.817471 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:08.947273 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.955213 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.956741 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:08.958141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-026ecaf7-80c2-482c-b593-3db0b4c0bb97 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1723 microversion: 2.20 time: 0.153571 Aug 01 14:13:08.958703 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 318/631] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:08 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:09.239106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e9dd7e75-ba77-4180-8339-5e8e6545673b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:09.240508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e9dd7e75-ba77-4180-8339-5e8e6545673b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:09.245729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9dd7e75-ba77-4180-8339-5e8e6545673b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.246171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9dd7e75-ba77-4180-8339-5e8e6545673b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.246930 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9dd7e75-ba77-4180-8339-5e8e6545673b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.248288 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e9dd7e75-ba77-4180-8339-5e8e6545673b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.268763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-84d087d5-119d-41ca-9a31-d08939bf4fb5 req-2938ef87-6396-44ff-801f-99d6eddf522c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fd7ad6-9939-4561-b0fa-f45f8602eccf", "name": "network-vif-unplugged", "status": "completed", "tag": "74f5404a-20d0-4b4a-8fec-5f4dbc58380a"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:09.279622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-84d087d5-119d-41ca-9a31-d08939bf4fb5 req-2938ef87-6396-44ff-801f-99d6eddf522c service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.280083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-84d087d5-119d-41ca-9a31-d08939bf4fb5 req-2938ef87-6396-44ff-801f-99d6eddf522c service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.291884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-84d087d5-119d-41ca-9a31-d08939bf4fb5 req-2938ef87-6396-44ff-801f-99d6eddf522c service nova] Creating event network-vif-unplugged:74f5404a-20d0-4b4a-8fec-5f4dbc58380a for instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf on hv-cinder-84713 Aug 01 14:13:09.297083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-84d087d5-119d-41ca-9a31-d08939bf4fb5 req-2938ef87-6396-44ff-801f-99d6eddf522c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032029 Aug 01 14:13:09.297844 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 319/632] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:09.522919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e9dd7e75-ba77-4180-8339-5e8e6545673b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:09.530958 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e9dd7e75-ba77-4180-8339-5e8e6545673b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.296005 Aug 01 14:13:09.531531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 314/633] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:09 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:09.539087 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bc1e3cbe-abd2-42e2-ae4e-d157d77c541a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:09.539807 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bc1e3cbe-abd2-42e2-ae4e-d157d77c541a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:09.546191 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bc1e3cbe-abd2-42e2-ae4e-d157d77c541a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.546640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bc1e3cbe-abd2-42e2-ae4e-d157d77c541a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.547404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bc1e3cbe-abd2-42e2-ae4e-d157d77c541a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.547834 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bc1e3cbe-abd2-42e2-ae4e-d157d77c541a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.679074 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bc1e3cbe-abd2-42e2-ae4e-d157d77c541a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:09.688921 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bc1e3cbe-abd2-42e2-ae4e-d157d77c541a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.153986 Aug 01 14:13:09.689517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 320/634] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:09 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:09.822150 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-102a4378-1c0c-41a0-8f44-ae216e411e11 req-0bf25e2b-3bed-49f8-a43b-038adf29fc76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5267261-9998-448b-98a6-26f44d18c68d", "tag": "3a4ba916-33f4-4318-9afe-1d671481726f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:09.831555 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-102a4378-1c0c-41a0-8f44-ae216e411e11 req-0bf25e2b-3bed-49f8-a43b-038adf29fc76 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.832015 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-102a4378-1c0c-41a0-8f44-ae216e411e11 req-0bf25e2b-3bed-49f8-a43b-038adf29fc76 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.843365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-102a4378-1c0c-41a0-8f44-ae216e411e11 req-0bf25e2b-3bed-49f8-a43b-038adf29fc76 service nova] Creating event network-changed:3a4ba916-33f4-4318-9afe-1d671481726f for instance c5267261-9998-448b-98a6-26f44d18c68d on hv-cinder-84713 Aug 01 14:13:09.848411 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-102a4378-1c0c-41a0-8f44-ae216e411e11 req-0bf25e2b-3bed-49f8-a43b-038adf29fc76 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030500 Aug 01 14:13:09.849029 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 315/635] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:09.981838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:09.982446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:09.988407 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.988888 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:09.989648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:09.990084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.118666 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.126794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.128314 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.129526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-cc030f5e-d99a-4202-abc9-b7ee89cdc548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1723 microversion: 2.20 time: 0.151850 Aug 01 14:13:10.130085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 321/636] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:09 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:10.551768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5a658c8f-6b2c-4c00-b4bd-2b04d92d1e73 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:10.552614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5a658c8f-6b2c-4c00-b4bd-2b04d92d1e73 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:10.558934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a658c8f-6b2c-4c00-b4bd-2b04d92d1e73 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.559382 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a658c8f-6b2c-4c00-b4bd-2b04d92d1e73 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.560138 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a658c8f-6b2c-4c00-b4bd-2b04d92d1e73 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.560605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5a658c8f-6b2c-4c00-b4bd-2b04d92d1e73 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.692102 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5a658c8f-6b2c-4c00-b4bd-2b04d92d1e73 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.699504 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5a658c8f-6b2c-4c00-b4bd-2b04d92d1e73 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1367 microversion: 2.1 time: 0.152050 Aug 01 14:13:10.700070 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 316/637] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:10 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:10.709846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-76378d00-a261-4bcb-8e88-a3930017c844 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:10.710955 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-76378d00-a261-4bcb-8e88-a3930017c844 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:10.717456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76378d00-a261-4bcb-8e88-a3930017c844 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.717911 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76378d00-a261-4bcb-8e88-a3930017c844 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.718674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76378d00-a261-4bcb-8e88-a3930017c844 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:10.719113 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76378d00-a261-4bcb-8e88-a3930017c844 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:10.734279 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:10.846603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-76378d00-a261-4bcb-8e88-a3930017c844 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:10.854478 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-76378d00-a261-4bcb-8e88-a3930017c844 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.148745 Aug 01 14:13:10.855046 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 322/638] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:10 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:11.153354 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:11.153954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.159860 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.160324 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.161102 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.161530 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.291937 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.299733 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.301278 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.302417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-807f429d-0f01-4bf4-8317-5178b57d3736 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1726 microversion: 2.20 time: 0.152935 Aug 01 14:13:11.302973 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 317/639] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:11 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1726 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:11.324635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dd5ad3c8-b44a-44d6-95d2-40c031b4597b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca6e5fd3-e844-4daf-8a73-3e5bed2db9b5"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:11.327010 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dd5ad3c8-b44a-44d6-95d2-40c031b4597b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.333237 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dd5ad3c8-b44a-44d6-95d2-40c031b4597b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.333691 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dd5ad3c8-b44a-44d6-95d2-40c031b4597b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.334452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dd5ad3c8-b44a-44d6-95d2-40c031b4597b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.334890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dd5ad3c8-b44a-44d6-95d2-40c031b4597b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.636294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dd5ad3c8-b44a-44d6-95d2-40c031b4597b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.315556 Aug 01 14:13:11.636999 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 323/640] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Aug 1 14:13:11 2022] POST /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:13:11.721739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5e9ca1c8-7df2-45e2-bbf8-8d604670f812 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:11.722352 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5e9ca1c8-7df2-45e2-bbf8-8d604670f812 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.731755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e9ca1c8-7df2-45e2-bbf8-8d604670f812 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.732209 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e9ca1c8-7df2-45e2-bbf8-8d604670f812 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.733043 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e9ca1c8-7df2-45e2-bbf8-8d604670f812 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.733483 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5e9ca1c8-7df2-45e2-bbf8-8d604670f812 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.760522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7ed8fae3-d73f-4f4a-a5da-897faedb33a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:11.761208 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7ed8fae3-d73f-4f4a-a5da-897faedb33a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.770255 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ed8fae3-d73f-4f4a-a5da-897faedb33a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.770702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ed8fae3-d73f-4f4a-a5da-897faedb33a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.771470 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ed8fae3-d73f-4f4a-a5da-897faedb33a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.771903 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ed8fae3-d73f-4f4a-a5da-897faedb33a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.815650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7ed8fae3-d73f-4f4a-a5da-897faedb33a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117857) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:13:11.883726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7ed8fae3-d73f-4f4a-a5da-897faedb33a6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/action" status: 202 len: 0 microversion: 2.20 time: 0.127409 Aug 01 14:13:11.887751 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 324/641] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 14:13:11 2022] POST /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:13:11.890400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a05269f8-21be-4fff-b780-79d8eebba6f2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:11.891740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a05269f8-21be-4fff-b780-79d8eebba6f2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.897964 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a05269f8-21be-4fff-b780-79d8eebba6f2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.898417 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a05269f8-21be-4fff-b780-79d8eebba6f2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.899191 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a05269f8-21be-4fff-b780-79d8eebba6f2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.899624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a05269f8-21be-4fff-b780-79d8eebba6f2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.963050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5e9ca1c8-7df2-45e2-bbf8-8d604670f812 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:11.975427 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5e9ca1c8-7df2-45e2-bbf8-8d604670f812 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1558 microversion: 2.1 time: 0.258130 Aug 01 14:13:11.976206 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 318/642] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:11 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1558 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:11.981271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:11.982281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:11.990789 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.992847 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:11.993757 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:11.994212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:12.069158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a05269f8-21be-4fff-b780-79d8eebba6f2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:12.077209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a05269f8-21be-4fff-b780-79d8eebba6f2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.190471 Aug 01 14:13:12.078182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 325/643] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:11 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:12.083580 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6f3310dd-54b7-40a7-b20d-29255611611b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:12.084275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6f3310dd-54b7-40a7-b20d-29255611611b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:12.094202 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6f3310dd-54b7-40a7-b20d-29255611611b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:12.094670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6f3310dd-54b7-40a7-b20d-29255611611b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:12.095514 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6f3310dd-54b7-40a7-b20d-29255611611b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:12.096048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6f3310dd-54b7-40a7-b20d-29255611611b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:12.134896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:12.143397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:12.145821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:12.146994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e50a2b43-29a3-4a54-86f6-47d6e4fd35fd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1752 microversion: 2.20 time: 0.169562 Aug 01 14:13:12.148230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 319/644] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:11 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:12.178360 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6f3310dd-54b7-40a7-b20d-29255611611b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.098881 Aug 01 14:13:12.179081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 326/645] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 14:13:12 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:13.098111 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1f7c9862-af57-4663-b92e-2af7091aadeb tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:13.099261 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1f7c9862-af57-4663-b92e-2af7091aadeb tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:13.106104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f7c9862-af57-4663-b92e-2af7091aadeb tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.106625 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f7c9862-af57-4663-b92e-2af7091aadeb tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.107465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f7c9862-af57-4663-b92e-2af7091aadeb tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.108199 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f7c9862-af57-4663-b92e-2af7091aadeb tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.130815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-d34dda50-821f-4a90-a226-d9cabd5916c3 req-02ef2a89-9086-4357-9695-06ba5e4592fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98847e8e-92b8-46b9-bb66-3b374c9a81b0", "tag": "b94eab45-df8a-46b1-8ac7-6a080ffcb4e7"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:13.140290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d34dda50-821f-4a90-a226-d9cabd5916c3 req-02ef2a89-9086-4357-9695-06ba5e4592fa service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.141031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d34dda50-821f-4a90-a226-d9cabd5916c3 req-02ef2a89-9086-4357-9695-06ba5e4592fa service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.171772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-d34dda50-821f-4a90-a226-d9cabd5916c3 req-02ef2a89-9086-4357-9695-06ba5e4592fa service nova] Creating event network-changed:b94eab45-df8a-46b1-8ac7-6a080ffcb4e7 for instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 on hv-cinder-84713 Aug 01 14:13:13.184131 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-d34dda50-821f-4a90-a226-d9cabd5916c3 req-02ef2a89-9086-4357-9695-06ba5e4592fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057204 Aug 01 14:13:13.185917 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 327/646] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:13.192238 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:13.193084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:13.199349 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.199919 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.200822 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:13.201357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:13.258781 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1f7c9862-af57-4663-b92e-2af7091aadeb tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.267286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1f7c9862-af57-4663-b92e-2af7091aadeb tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.173335 Aug 01 14:13:13.268465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 320/647] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:13 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:13.345612 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.356815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.359143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:13.360383 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f078403c-7db0-4607-8d9d-90eaf3019d34 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1752 microversion: 2.20 time: 0.173384 Aug 01 14:13:13.360991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 328/648] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:13 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:14.289638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-37021922-8438-4858-99a4-395c2cb2ae87 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:14.290504 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-37021922-8438-4858-99a4-395c2cb2ae87 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:14.293700 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:14.297904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37021922-8438-4858-99a4-395c2cb2ae87 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.298348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37021922-8438-4858-99a4-395c2cb2ae87 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.299143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37021922-8438-4858-99a4-395c2cb2ae87 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.299572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-37021922-8438-4858-99a4-395c2cb2ae87 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.383431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:14.384039 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:14.386147 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:14.387023 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=6 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:14.393855 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.394299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.395271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:14.395894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:14.436899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-37021922-8438-4858-99a4-395c2cb2ae87 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.444317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-37021922-8438-4858-99a4-395c2cb2ae87 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.159658 Aug 01 14:13:14.444970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 321/649] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:14 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:14.527600 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.535791 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.537316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:14.538481 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6c962c37-a516-47bf-a538-157bb2d6e577 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1752 microversion: 2.20 time: 0.159011 Aug 01 14:13:14.539059 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 329/650] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:14 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:15.466000 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d796dc71-3db3-4592-bc54-de0f4861d43f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:15.467335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d796dc71-3db3-4592-bc54-de0f4861d43f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:15.472556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d796dc71-3db3-4592-bc54-de0f4861d43f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.473000 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d796dc71-3db3-4592-bc54-de0f4861d43f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.473751 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d796dc71-3db3-4592-bc54-de0f4861d43f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.474179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d796dc71-3db3-4592-bc54-de0f4861d43f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.561650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:15.562273 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:15.569636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.570174 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.571048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:15.571582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:15.640866 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d796dc71-3db3-4592-bc54-de0f4861d43f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.650141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d796dc71-3db3-4592-bc54-de0f4861d43f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.188424 Aug 01 14:13:15.650901 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 322/651] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:15 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:15.719621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.728673 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.730196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:15.731340 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ce79446d-6a80-47fa-aeda-825f57be0c01 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1752 microversion: 2.20 time: 0.173791 Aug 01 14:13:15.731895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 330/652] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:15 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:16.671331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-12ab6c33-f624-4f68-9016-378f855e7162 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:16.671934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-12ab6c33-f624-4f68-9016-378f855e7162 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:16.677924 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12ab6c33-f624-4f68-9016-378f855e7162 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.678365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12ab6c33-f624-4f68-9016-378f855e7162 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.679612 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12ab6c33-f624-4f68-9016-378f855e7162 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.680073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12ab6c33-f624-4f68-9016-378f855e7162 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.754883 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:16.755509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:16.762621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.763066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.763830 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:16.764265 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:16.815076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-12ab6c33-f624-4f68-9016-378f855e7162 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:16.823298 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-12ab6c33-f624-4f68-9016-378f855e7162 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.155762 Aug 01 14:13:16.823991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 323/653] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:16 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:16.905832 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:16.914694 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:16.916231 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:16.917423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-96f5bf33-b659-4232-bf56-dbd9be2f732e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1754 microversion: 2.20 time: 0.166710 Aug 01 14:13:16.917982 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 331/654] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:16 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:17.669058 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-f29a3ab7-862b-4f58-ba97-dd006b531262 req-2f399073-7f7c-4761-98fe-a2f69f120326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5267261-9998-448b-98a6-26f44d18c68d", "name": "network-vif-plugged", "status": "completed", "tag": "3a4ba916-33f4-4318-9afe-1d671481726f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:17.679322 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f29a3ab7-862b-4f58-ba97-dd006b531262 req-2f399073-7f7c-4761-98fe-a2f69f120326 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.679906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f29a3ab7-862b-4f58-ba97-dd006b531262 req-2f399073-7f7c-4761-98fe-a2f69f120326 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.691420 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-f29a3ab7-862b-4f58-ba97-dd006b531262 req-2f399073-7f7c-4761-98fe-a2f69f120326 service nova] Creating event network-vif-plugged:3a4ba916-33f4-4318-9afe-1d671481726f for instance c5267261-9998-448b-98a6-26f44d18c68d on hv-cinder-84713 Aug 01 14:13:17.696523 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-f29a3ab7-862b-4f58-ba97-dd006b531262 req-2f399073-7f7c-4761-98fe-a2f69f120326 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030988 Aug 01 14:13:17.697185 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 324/655] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:13:17.846182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-eb407ce9-2c2b-4253-a6b5-3ca1ccaa08da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:17.847530 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-eb407ce9-2c2b-4253-a6b5-3ca1ccaa08da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:17.855532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb407ce9-2c2b-4253-a6b5-3ca1ccaa08da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.856313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb407ce9-2c2b-4253-a6b5-3ca1ccaa08da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.857380 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb407ce9-2c2b-4253-a6b5-3ca1ccaa08da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.858053 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-eb407ce9-2c2b-4253-a6b5-3ca1ccaa08da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.941404 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:17.942478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:17.950915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.953278 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.954063 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:17.956152 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:17.973672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:18.003576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-eb407ce9-2c2b-4253-a6b5-3ca1ccaa08da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:18.011185 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-eb407ce9-2c2b-4253-a6b5-3ca1ccaa08da tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.170477 Aug 01 14:13:18.011751 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 332/656] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:17 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:18.193888 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:18.202126 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:18.203610 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:18.204768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c2b7ea49-adf5-4572-8fd5-4ce93e3b0245 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.267606 Aug 01 14:13:18.205324 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 325/657] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:17 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:19.032216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-01a5a9e2-6740-4494-85a7-37229631f8b8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:19.032859 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-01a5a9e2-6740-4494-85a7-37229631f8b8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:19.039952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-01a5a9e2-6740-4494-85a7-37229631f8b8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.040398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-01a5a9e2-6740-4494-85a7-37229631f8b8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.041183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-01a5a9e2-6740-4494-85a7-37229631f8b8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.041612 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-01a5a9e2-6740-4494-85a7-37229631f8b8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.168261 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-01a5a9e2-6740-4494-85a7-37229631f8b8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:19.175624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-01a5a9e2-6740-4494-85a7-37229631f8b8 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.147246 Aug 01 14:13:19.176186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 333/658] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:19 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:19.228851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:19.229467 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:19.235572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.236020 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.236817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:19.237258 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:19.364621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:19.373928 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:19.375355 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:19.376549 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d528ce8b-8edc-46bd-8fe1-c9e083880d6d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.152494 Aug 01 14:13:19.377098 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 326/659] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:19 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:20.197544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-faab5f7c-3143-4ff7-be64-512bc4fe2d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:20.198395 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-faab5f7c-3143-4ff7-be64-512bc4fe2d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:20.205984 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-faab5f7c-3143-4ff7-be64-512bc4fe2d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.206795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-faab5f7c-3143-4ff7-be64-512bc4fe2d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.208035 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-faab5f7c-3143-4ff7-be64-512bc4fe2d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.208877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-faab5f7c-3143-4ff7-be64-512bc4fe2d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.365613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-faab5f7c-3143-4ff7-be64-512bc4fe2d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.373219 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-faab5f7c-3143-4ff7-be64-512bc4fe2d01 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.179925 Aug 01 14:13:20.373788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 334/660] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:20 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:20.398887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:20.399520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:20.401902 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=70 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:20.407537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.407987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.408790 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:20.409230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:20.555785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.564835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.566490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:20.567739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aaac8a26-e1fb-47f3-a606-888c94d40650 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.173215 Aug 01 14:13:20.568311 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 327/661] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:20 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:21.394919 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ebb87b93-63b5-4768-bba0-f1e634ec2f94 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:21.395527 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ebb87b93-63b5-4768-bba0-f1e634ec2f94 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:21.398461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:21.403757 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ebb87b93-63b5-4768-bba0-f1e634ec2f94 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.404210 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ebb87b93-63b5-4768-bba0-f1e634ec2f94 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.404986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ebb87b93-63b5-4768-bba0-f1e634ec2f94 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.405422 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ebb87b93-63b5-4768-bba0-f1e634ec2f94 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.539153 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ebb87b93-63b5-4768-bba0-f1e634ec2f94 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.546545 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ebb87b93-63b5-4768-bba0-f1e634ec2f94 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.155466 Aug 01 14:13:21.547122 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 335/662] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:21 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:21.591552 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:21.592159 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:21.598194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.598637 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.599387 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:21.599818 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:21.729423 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.738174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.739952 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:21.741842 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-41d9c146-aaad-438c-9af7-e9a640b257c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.154152 Aug 01 14:13:21.751633 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 328/663] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:21 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:22.567479 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bafd440c-a9a2-4091-8ed7-c4081c01f47f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:22.568203 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bafd440c-a9a2-4091-8ed7-c4081c01f47f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:22.575567 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bafd440c-a9a2-4091-8ed7-c4081c01f47f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:22.576016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bafd440c-a9a2-4091-8ed7-c4081c01f47f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:22.576828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bafd440c-a9a2-4091-8ed7-c4081c01f47f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:22.577267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bafd440c-a9a2-4091-8ed7-c4081c01f47f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:22.593009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:22.729786 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bafd440c-a9a2-4091-8ed7-c4081c01f47f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:22.737416 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bafd440c-a9a2-4091-8ed7-c4081c01f47f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.173977 Aug 01 14:13:22.737995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 336/664] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:22 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:22.765812 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:22.766428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:22.772673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:22.773124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:22.773896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:22.774331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:22.907012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:22.916864 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:22.918367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:22.919558 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d726d3ca-0e8e-41ec-b140-d2760fceac46 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.158027 Aug 01 14:13:22.920156 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 329/665] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:22 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:23.759273 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9cc6bde0-76ed-4aff-ab5a-305c04520dd9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:23.759918 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9cc6bde0-76ed-4aff-ab5a-305c04520dd9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:23.766489 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9cc6bde0-76ed-4aff-ab5a-305c04520dd9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.766939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9cc6bde0-76ed-4aff-ab5a-305c04520dd9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.767725 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9cc6bde0-76ed-4aff-ab5a-305c04520dd9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.768145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9cc6bde0-76ed-4aff-ab5a-305c04520dd9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.906179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9cc6bde0-76ed-4aff-ab5a-305c04520dd9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:23.913809 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9cc6bde0-76ed-4aff-ab5a-305c04520dd9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.158932 Aug 01 14:13:23.914367 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 337/666] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:23 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:23.942904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:23.943529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:23.949992 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.950431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:23.951293 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:23.951807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:24.085103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:24.093467 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:24.094971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:24.096123 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ca113891-6b43-40b5-a3b6-ea1101f54428 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.157033 Aug 01 14:13:24.096725 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 330/667] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:23 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:24.934177 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-51fc6f54-7ac5-4215-8ee1-f6b5e3c42ea2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:24.934877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-51fc6f54-7ac5-4215-8ee1-f6b5e3c42ea2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:24.941584 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51fc6f54-7ac5-4215-8ee1-f6b5e3c42ea2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:24.942075 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51fc6f54-7ac5-4215-8ee1-f6b5e3c42ea2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:24.942853 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51fc6f54-7ac5-4215-8ee1-f6b5e3c42ea2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:24.943291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51fc6f54-7ac5-4215-8ee1-f6b5e3c42ea2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.074423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-51fc6f54-7ac5-4215-8ee1-f6b5e3c42ea2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.082268 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-51fc6f54-7ac5-4215-8ee1-f6b5e3c42ea2 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.151673 Aug 01 14:13:25.092954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 338/668] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:24 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:25.118228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:25.118835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:25.124852 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.125288 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.126033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:25.126457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:25.262485 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.270936 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.272436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:25.273662 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fe89688d-4f53-4950-bcae-b7faa22e3dbf tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.159269 Aug 01 14:13:25.274221 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 331/669] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:25 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:26.103835 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-de930e7c-003f-4bbf-bfd4-1c0a89a07a7e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.104432 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-de930e7c-003f-4bbf-bfd4-1c0a89a07a7e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:26.110864 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-de930e7c-003f-4bbf-bfd4-1c0a89a07a7e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.111312 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-de930e7c-003f-4bbf-bfd4-1c0a89a07a7e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.112068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-de930e7c-003f-4bbf-bfd4-1c0a89a07a7e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.112560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-de930e7c-003f-4bbf-bfd4-1c0a89a07a7e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.251402 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-de930e7c-003f-4bbf-bfd4-1c0a89a07a7e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.258779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-de930e7c-003f-4bbf-bfd4-1c0a89a07a7e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.159521 Aug 01 14:13:26.259352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 339/670] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:26 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:26.296792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:26.297408 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:26.303597 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.304038 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.304899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:26.305335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:26.435917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.444672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.446201 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:26.447334 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8365f065-7840-4dc2-9bca-67b6acbe203d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.154575 Aug 01 14:13:26.447884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 332/671] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:26 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:27.279303 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-870ca712-9f0a-4cc8-a012-8f735d3d7d90 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:27.280026 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-870ca712-9f0a-4cc8-a012-8f735d3d7d90 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:27.286590 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-870ca712-9f0a-4cc8-a012-8f735d3d7d90 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.287042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-870ca712-9f0a-4cc8-a012-8f735d3d7d90 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.287809 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-870ca712-9f0a-4cc8-a012-8f735d3d7d90 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.288243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-870ca712-9f0a-4cc8-a012-8f735d3d7d90 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.424464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-870ca712-9f0a-4cc8-a012-8f735d3d7d90 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:27.434251 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-870ca712-9f0a-4cc8-a012-8f735d3d7d90 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.158786 Aug 01 14:13:27.434845 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 340/672] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:27 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:27.470524 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:27.471127 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:27.477690 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.478162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.478916 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:27.479363 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:27.611383 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:27.619896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:27.621454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:27.622598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d2eb248a-fe30-4052-9f14-c4d97c215c68 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.155960 Aug 01 14:13:27.623156 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 333/673] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:27 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:28.455118 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-618bd898-8ff7-4944-bfb1-27d368ec4fa9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:28.455727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-618bd898-8ff7-4944-bfb1-27d368ec4fa9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:28.463099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-618bd898-8ff7-4944-bfb1-27d368ec4fa9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.463539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-618bd898-8ff7-4944-bfb1-27d368ec4fa9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.464297 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-618bd898-8ff7-4944-bfb1-27d368ec4fa9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.464765 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-618bd898-8ff7-4944-bfb1-27d368ec4fa9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.606516 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-618bd898-8ff7-4944-bfb1-27d368ec4fa9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:28.614126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-618bd898-8ff7-4944-bfb1-27d368ec4fa9 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.162817 Aug 01 14:13:28.614712 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 341/674] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:28 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:28.646015 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:28.646781 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:28.653670 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.654116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.654887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:28.655329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:28.790608 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:28.799029 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:28.800617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:28.801775 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4580741d-259c-41e7-9c8f-e35595a3812b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.159714 Aug 01 14:13:28.802322 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 334/675] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:28 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:29.635453 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-28426e7c-58dd-4657-be30-f551e19b09ed tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:29.636066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-28426e7c-58dd-4657-be30-f551e19b09ed tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:29.642980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28426e7c-58dd-4657-be30-f551e19b09ed tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.643380 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28426e7c-58dd-4657-be30-f551e19b09ed tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.644147 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28426e7c-58dd-4657-be30-f551e19b09ed tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.644602 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28426e7c-58dd-4657-be30-f551e19b09ed tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.782115 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-28426e7c-58dd-4657-be30-f551e19b09ed tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:29.791037 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-28426e7c-58dd-4657-be30-f551e19b09ed tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.159746 Aug 01 14:13:29.791616 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 342/676] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:29 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:29.824956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:29.825596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:29.831575 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.832270 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.833047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:29.833484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:29.966281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:29.974806 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:29.976981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:29.978157 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ff0a6e92-a131-4eba-b901-1f95ec99b644 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.157060 Aug 01 14:13:29.978722 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 335/677] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:29 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:30.813357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-20062be8-6152-40d5-8bca-273538e9d123 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:30.814137 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-20062be8-6152-40d5-8bca-273538e9d123 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:30.821877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-20062be8-6152-40d5-8bca-273538e9d123 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:30.822270 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-20062be8-6152-40d5-8bca-273538e9d123 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:30.823172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-20062be8-6152-40d5-8bca-273538e9d123 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:30.823700 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-20062be8-6152-40d5-8bca-273538e9d123 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:30.958101 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-20062be8-6152-40d5-8bca-273538e9d123 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:30.966144 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-20062be8-6152-40d5-8bca-273538e9d123 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.156712 Aug 01 14:13:30.966838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 343/678] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:30 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:31.000984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:31.001749 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:31.008268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:31.008751 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:31.009537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:31.009974 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:31.155842 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:31.164649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:31.166150 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:31.167287 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-54ee6dae-9587-498d-be15-4197f4489c92 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.170282 Aug 01 14:13:31.167869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 336/679] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:30 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:31.987253 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c5fb05bc-dddb-4734-9cf5-1211ea377605 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:31.988168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c5fb05bc-dddb-4734-9cf5-1211ea377605 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:31.994594 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c5fb05bc-dddb-4734-9cf5-1211ea377605 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:31.995036 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c5fb05bc-dddb-4734-9cf5-1211ea377605 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:31.995783 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c5fb05bc-dddb-4734-9cf5-1211ea377605 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:31.996211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c5fb05bc-dddb-4734-9cf5-1211ea377605 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.131628 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c5fb05bc-dddb-4734-9cf5-1211ea377605 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:32.146716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c5fb05bc-dddb-4734-9cf5-1211ea377605 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.163167 Aug 01 14:13:32.147308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 344/680] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:31 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:32.191204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:32.192923 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:32.199745 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:32.200447 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.201259 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:32.201698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:32.329452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:32.338053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:32.339563 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:32.340742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4b81136f-cb36-4100-8982-fce389aa5d3d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.153597 Aug 01 14:13:32.341305 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 337/681] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:32 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:33.169563 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-48129016-469f-42e2-a13c-6fb494dcf3b7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:33.170162 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-48129016-469f-42e2-a13c-6fb494dcf3b7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:33.176707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48129016-469f-42e2-a13c-6fb494dcf3b7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.177163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48129016-469f-42e2-a13c-6fb494dcf3b7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.177930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48129016-469f-42e2-a13c-6fb494dcf3b7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.178370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48129016-469f-42e2-a13c-6fb494dcf3b7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.310106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-48129016-469f-42e2-a13c-6fb494dcf3b7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:33.317449 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-48129016-469f-42e2-a13c-6fb494dcf3b7 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.151814 Aug 01 14:13:33.318011 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 345/682] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:33 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:13:33.363483 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:33.364119 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:33.370473 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.370919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.371726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:33.372160 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:33.502103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:33.511596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:33.513176 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:33.514506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-38946b99-9587-4a45-a40d-53b659ae30e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.155007 Aug 01 14:13:33.515304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 338/683] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:33 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:34.339381 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-66fa974d-ca9c-4b1f-9947-23f5101cdf9b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:34.339939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-66fa974d-ca9c-4b1f-9947-23f5101cdf9b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:34.346540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-66fa974d-ca9c-4b1f-9947-23f5101cdf9b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:34.346993 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-66fa974d-ca9c-4b1f-9947-23f5101cdf9b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:34.347760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-66fa974d-ca9c-4b1f-9947-23f5101cdf9b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:34.348198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-66fa974d-ca9c-4b1f-9947-23f5101cdf9b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:34.484717 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-66fa974d-ca9c-4b1f-9947-23f5101cdf9b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:34.492670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-66fa974d-ca9c-4b1f-9947-23f5101cdf9b tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.157815 Aug 01 14:13:34.493231 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 346/684] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:34 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:34.538378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:34.539120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:34.545286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:34.545729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:34.546494 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:34.546920 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:34.680917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:34.690146 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:34.691651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:34.692851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8c0915e6-0d90-45b5-99a1-45d4610e3ea6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.158339 Aug 01 14:13:34.693423 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 339/685] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:34 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:35.513819 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-841664bc-1215-4e8f-9352-51548df064bc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:35.514429 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-841664bc-1215-4e8f-9352-51548df064bc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:35.521143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-841664bc-1215-4e8f-9352-51548df064bc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:35.521593 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-841664bc-1215-4e8f-9352-51548df064bc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:35.522352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-841664bc-1215-4e8f-9352-51548df064bc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:35.523357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-841664bc-1215-4e8f-9352-51548df064bc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:35.654554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-841664bc-1215-4e8f-9352-51548df064bc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:35.662307 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-841664bc-1215-4e8f-9352-51548df064bc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.152274 Aug 01 14:13:35.662886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 347/686] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:35 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:35.717268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:35.718101 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:35.724378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:35.724865 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:35.726056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:35.726877 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:35.864546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:35.874002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:35.875493 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:35.876686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ce4bc85f-89a3-4784-a3fd-a7fa63e17775 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.163390 Aug 01 14:13:35.877470 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 340/687] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:35 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:36.683482 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-48881de8-77eb-415c-bce7-30675e0f7525 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:36.684100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-48881de8-77eb-415c-bce7-30675e0f7525 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:36.690854 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48881de8-77eb-415c-bce7-30675e0f7525 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.691249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48881de8-77eb-415c-bce7-30675e0f7525 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:36.692006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48881de8-77eb-415c-bce7-30675e0f7525 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.692470 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-48881de8-77eb-415c-bce7-30675e0f7525 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:36.824782 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-48881de8-77eb-415c-bce7-30675e0f7525 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:36.832293 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-48881de8-77eb-415c-bce7-30675e0f7525 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.152750 Aug 01 14:13:36.832882 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 348/688] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:36 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:36.903355 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:36.903956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:36.909970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.910491 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:36.911359 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:36.911893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:37.046666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:37.054977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:37.056500 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:37.057668 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-22d764d4-fef2-4e39-8a26-0ee762b05a69 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.159342 Aug 01 14:13:37.058224 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 341/689] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:36 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:37.853837 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5c850e5f-04e2-44e9-b1c7-4bdd4b78e28f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:37.854444 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5c850e5f-04e2-44e9-b1c7-4bdd4b78e28f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:37.861000 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5c850e5f-04e2-44e9-b1c7-4bdd4b78e28f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:37.861440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5c850e5f-04e2-44e9-b1c7-4bdd4b78e28f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:37.862190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5c850e5f-04e2-44e9-b1c7-4bdd4b78e28f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:37.862615 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5c850e5f-04e2-44e9-b1c7-4bdd4b78e28f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:37.995123 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5c850e5f-04e2-44e9-b1c7-4bdd4b78e28f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:38.005711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5c850e5f-04e2-44e9-b1c7-4bdd4b78e28f tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.155982 Aug 01 14:13:38.006567 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 349/690] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:37 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:38.080960 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:38.081764 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:38.087888 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:38.088340 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:38.089143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:38.089579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:38.093454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:38.217164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:38.226100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:38.227607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:38.228860 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-02c43933-3dde-48be-a32d-43bf455b66a1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.151818 Aug 01 14:13:38.229425 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 342/691] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:38 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:39.026478 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4edf0356-78d8-4f03-b94d-afe0ca2dc353 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.027083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4edf0356-78d8-4f03-b94d-afe0ca2dc353 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:39.033463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4edf0356-78d8-4f03-b94d-afe0ca2dc353 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.033906 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4edf0356-78d8-4f03-b94d-afe0ca2dc353 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.034650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4edf0356-78d8-4f03-b94d-afe0ca2dc353 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.035079 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4edf0356-78d8-4f03-b94d-afe0ca2dc353 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.161827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4edf0356-78d8-4f03-b94d-afe0ca2dc353 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:39.169452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4edf0356-78d8-4f03-b94d-afe0ca2dc353 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1319 microversion: 2.1 time: 0.146784 Aug 01 14:13:39.170014 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 350/692] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:39 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:39.251144 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:39.251744 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:39.258497 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.258934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.259684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:39.260111 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:39.389476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:39.397751 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:39.399317 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:39.400405 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-22967a6a-693f-4dfe-aab7-809e43dc7dcb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.153220 Aug 01 14:13:39.400984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 343/693] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:39 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:40.190496 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dc8f06cf-9da0-4cde-9b02-c364aac79aaa tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:40.191119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dc8f06cf-9da0-4cde-9b02-c364aac79aaa tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:40.198044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc8f06cf-9da0-4cde-9b02-c364aac79aaa tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.198485 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc8f06cf-9da0-4cde-9b02-c364aac79aaa tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.199244 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc8f06cf-9da0-4cde-9b02-c364aac79aaa tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.199680 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dc8f06cf-9da0-4cde-9b02-c364aac79aaa tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.331812 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dc8f06cf-9da0-4cde-9b02-c364aac79aaa tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:40.339828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dc8f06cf-9da0-4cde-9b02-c364aac79aaa tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1505 microversion: 2.1 time: 0.153293 Aug 01 14:13:40.340392 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 351/694] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:40 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:13:40.359595 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-961bf81f-d95d-4be0-907d-bbc26444a01a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4164fa3-15c9-4655-b0ed-b64bd8d6bc5b", "device": "/dev/sdb"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:40.362554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-961bf81f-d95d-4be0-907d-bbc26444a01a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:40.369222 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-961bf81f-d95d-4be0-907d-bbc26444a01a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.369666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-961bf81f-d95d-4be0-907d-bbc26444a01a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.370426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-961bf81f-d95d-4be0-907d-bbc26444a01a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.370857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-961bf81f-d95d-4be0-907d-bbc26444a01a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.423321 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:40.423940 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:40.431059 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.432077 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.432613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:40.433063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:40.561811 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:40.570870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:40.572400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:40.573587 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3d016437-89b6-4836-8f6d-a73a2ad6d9ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.154301 Aug 01 14:13:40.574196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 352/695] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:40 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:41.596974 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:41.597680 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:41.604515 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:41.604970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:41.605716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:41.606145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:41.608644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:41.744084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:41.752497 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:41.755014 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:41.756185 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-89b38a9e-aaa4-4a2b-bf5f-130a77b716ae tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.163156 Aug 01 14:13:41.756799 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 353/696] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:41 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:13:42.430201 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-961bf81f-d95d-4be0-907d-bbc26444a01a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "POST /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.074163 Aug 01 14:13:42.430944 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 344/697] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:13:40 2022] POST /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d/os-volume_attachments => generated 194 bytes in 2076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:42.779188 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:42.779818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:42.786340 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:42.786795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.788170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:42.788647 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:42.916789 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:42.925180 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:42.926698 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:42.927847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fdb4e6d1-b594-4ff8-8827-51b72f3e4965 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.152627 Aug 01 14:13:42.928406 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 354/698] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:42 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:43.950828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:43.951528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:43.958097 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:43.958549 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:43.960232 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:43.960232 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:44.089495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:44.097904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:44.099412 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:44.101099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ae6d1259-a61a-4070-ac40-3f152a1f942a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.155025 Aug 01 14:13:44.101660 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 345/699] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:43 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:45.124668 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:45.125232 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:45.132023 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:45.132508 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:45.133259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:45.133704 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:45.259701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:45.268007 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:45.269595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:45.270774 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d459f0cf-05ba-411c-86dd-ba7880ee78d8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.150185 Aug 01 14:13:45.271340 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 355/700] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:45 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:46.293862 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:46.294472 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:46.301328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:46.301780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:46.302545 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:46.302981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:46.430584 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:46.438988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:46.440823 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:46.441968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-00498e6b-654e-449d-9b6e-74d03717eee8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.152114 Aug 01 14:13:46.442883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 346/701] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:46 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:47.466008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:47.466623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:47.473271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:47.473726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:47.475087 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:47.475540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:47.607637 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:47.616050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:47.617591 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:47.618733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8a993482-bf62-4cd2-ab77-f47304a0e81c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.156644 Aug 01 14:13:47.619291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 356/702] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:47 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:48.641381 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:48.641989 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:48.648989 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:48.649433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:48.650182 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:48.650609 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:48.780378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:48.789303 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:48.790963 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:48.792145 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-edef44e0-0fa0-4994-80d8-f256cc9cae1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.154598 Aug 01 14:13:48.792726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 347/703] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:48 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:49.815224 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:49.815946 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:49.822626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:49.823072 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:49.823837 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:49.824267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:49.958237 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:49.966696 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:49.968227 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:49.969421 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-df527669-fd65-4b3c-ad9c-186e111e1595 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.158150 Aug 01 14:13:49.970009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 357/704] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:49 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:50.993275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:50.993912 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:50.996339 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=42 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:51.001748 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:51.002191 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:51.002959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:51.003388 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:51.138652 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:51.147234 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:51.148749 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:51.149885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-48c7bf15-cf53-4f6f-bec2-cb7d80df9c30 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.161396 Aug 01 14:13:51.150442 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 348/705] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:50 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:52.173565 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:52.174275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:52.176728 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=46 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:52.184038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:52.184515 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:52.185305 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:52.185926 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:52.243530 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-1a8f4d86-8969-4d5e-952e-a890ed63ad1c req-c5ea5681-bffd-41b4-8749-d171d5c4be33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fd7ad6-9939-4561-b0fa-f45f8602eccf", "name": "network-vif-plugged", "status": "completed", "tag": "74f5404a-20d0-4b4a-8fec-5f4dbc58380a"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:52.253369 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1a8f4d86-8969-4d5e-952e-a890ed63ad1c req-c5ea5681-bffd-41b4-8749-d171d5c4be33 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:52.253819 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1a8f4d86-8969-4d5e-952e-a890ed63ad1c req-c5ea5681-bffd-41b4-8749-d171d5c4be33 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:52.266004 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-1a8f4d86-8969-4d5e-952e-a890ed63ad1c req-c5ea5681-bffd-41b4-8749-d171d5c4be33 service nova] Creating event network-vif-plugged:74f5404a-20d0-4b4a-8fec-5f4dbc58380a for instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf on hv-cinder-84713 Aug 01 14:13:52.271942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-1a8f4d86-8969-4d5e-952e-a890ed63ad1c req-c5ea5681-bffd-41b4-8749-d171d5c4be33 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032986 Aug 01 14:13:52.272549 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 349/706] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:13:52.336731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:52.345314 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:52.346867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:52.348198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a1184a93-f568-4375-905f-f1e3a6082e1a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.178566 Aug 01 14:13:52.348803 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 358/707] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:52 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:53.372105 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:53.372837 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:53.379134 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:53.379584 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:53.380859 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:53.381295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:53.568490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:53.576899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:53.578399 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:53.579557 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a70d0843-b263-4bba-af83-dc40160b1868 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.212268 Aug 01 14:13:53.580119 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 350/708] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:53 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:54.603178 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:54.603784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:54.610284 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:54.610730 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:54.611487 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:54.611926 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:54.743261 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:54.751570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:54.753109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:54.754259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dec2607b-9d26-414d-ae1e-a741c3228d64 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.155735 Aug 01 14:13:54.754818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 359/709] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:54 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:55.777799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:55.778443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:55.785010 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:55.785453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:55.786206 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:55.787282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:55.916813 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:55.924986 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:55.926462 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:55.927593 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bbd7eae4-4ea8-476d-a615-bcc17a2d0d8e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.153721 Aug 01 14:13:55.928144 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 351/710] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:55 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:56.950011 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:56.950622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:56.957412 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:56.957858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:56.958664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:56.959094 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:57.136835 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:57.145199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:57.146707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:57.147859 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4e764dde-4651-481d-900e-35e5932d2b2f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.201869 Aug 01 14:13:57.148428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 360/711] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:56 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:58.171068 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:58.171686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:58.178681 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:58.179130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:58.179893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:58.180334 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:58.311817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:58.321329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:58.322925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:58.324159 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-29621c81-399e-4c58-a966-c9c438591d11 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.156963 Aug 01 14:13:58.324732 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 352/712] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:58 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:59.347387 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:59.348069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:59.354904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.355362 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.356133 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.356598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.420341 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-960edcea-61f3-44c8-841b-82eda1570f90 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:13:59.423424 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-960edcea-61f3-44c8-841b-82eda1570f90 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:59.431102 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-960edcea-61f3-44c8-841b-82eda1570f90 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.432005 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-960edcea-61f3-44c8-841b-82eda1570f90 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.433108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-960edcea-61f3-44c8-841b-82eda1570f90 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.433522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-960edcea-61f3-44c8-841b-82eda1570f90 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.496760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:59.508986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:59.511560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:59.513021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-960edcea-61f3-44c8-841b-82eda1570f90 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "POST /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/action" status: 202 len: 0 microversion: 2.1 time: 0.096276 Aug 01 14:13:59.513198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-301571a3-781c-4357-b9b5-7cc8f02c61e1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.169633 Aug 01 14:13:59.517809 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 353/713] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:13:59 2022] POST /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:13:59.518236 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 361/714] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:13:59 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:13:59.523976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-058b09b2-88e8-48f2-90fa-050b78d1e2ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:13:59.524743 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-058b09b2-88e8-48f2-90fa-050b78d1e2ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:13:59.531039 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-058b09b2-88e8-48f2-90fa-050b78d1e2ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.531496 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-058b09b2-88e8-48f2-90fa-050b78d1e2ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.532271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-058b09b2-88e8-48f2-90fa-050b78d1e2ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:13:59.532740 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-058b09b2-88e8-48f2-90fa-050b78d1e2ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:13:59.672160 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-058b09b2-88e8-48f2-90fa-050b78d1e2ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:13:59.680508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-058b09b2-88e8-48f2-90fa-050b78d1e2ed tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1751 microversion: 2.1 time: 0.161721 Aug 01 14:13:59.681072 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 354/715] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:13:59 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:00.542554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:00.543173 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:00.550687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:00.551141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:00.551919 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:00.552354 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:00.682283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:00.690531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:00.692039 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:00.693729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-43fef45e-f48e-418d-8163-ac5997df6165 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.155110 Aug 01 14:14:00.694284 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 362/716] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:00 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:00.702393 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3516725e-706c-4947-b247-a0d353b3edd6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:00.702941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3516725e-706c-4947-b247-a0d353b3edd6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:00.710274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3516725e-706c-4947-b247-a0d353b3edd6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:00.710723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3516725e-706c-4947-b247-a0d353b3edd6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:00.711485 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3516725e-706c-4947-b247-a0d353b3edd6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:00.711920 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3516725e-706c-4947-b247-a0d353b3edd6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:00.855762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3516725e-706c-4947-b247-a0d353b3edd6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:00.863555 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3516725e-706c-4947-b247-a0d353b3edd6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1751 microversion: 2.1 time: 0.165025 Aug 01 14:14:00.864191 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 355/717] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:00 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:14:01.716603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:01.717209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:01.723650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:01.724096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:01.724884 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:01.725318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:01.855423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:01.864999 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:01.866511 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:01.867660 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1d156872-1213-4b17-b6a9-3de71443c9a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.154973 Aug 01 14:14:01.868230 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 363/718] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:01 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:01.884472 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-06b9ddb0-2a72-477f-9050-d35e92fbc052 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:01.885161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-06b9ddb0-2a72-477f-9050-d35e92fbc052 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:01.891534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-06b9ddb0-2a72-477f-9050-d35e92fbc052 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:01.891979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-06b9ddb0-2a72-477f-9050-d35e92fbc052 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:01.892776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-06b9ddb0-2a72-477f-9050-d35e92fbc052 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:01.893218 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-06b9ddb0-2a72-477f-9050-d35e92fbc052 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:02.038108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-06b9ddb0-2a72-477f-9050-d35e92fbc052 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:02.046448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-06b9ddb0-2a72-477f-9050-d35e92fbc052 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1751 microversion: 2.1 time: 0.165707 Aug 01 14:14:02.047310 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 356/719] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:01 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:02.889633 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:02.890238 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:02.897222 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:02.897669 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:02.898417 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:02.898846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:03.026152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:03.034472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:03.036598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:03.037743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e66fe4d5-50d8-49d9-bb38-42ef1acb027c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.151958 Aug 01 14:14:03.038300 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 364/720] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:02 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:03.072692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bf7cddd5-8150-4b40-bb3d-0b1c74dd8901 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:03.073286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bf7cddd5-8150-4b40-bb3d-0b1c74dd8901 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:03.079684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf7cddd5-8150-4b40-bb3d-0b1c74dd8901 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:03.080398 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf7cddd5-8150-4b40-bb3d-0b1c74dd8901 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:03.081229 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf7cddd5-8150-4b40-bb3d-0b1c74dd8901 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:03.081672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf7cddd5-8150-4b40-bb3d-0b1c74dd8901 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:03.084811 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:03.229099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf7cddd5-8150-4b40-bb3d-0b1c74dd8901 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:03.236960 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bf7cddd5-8150-4b40-bb3d-0b1c74dd8901 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1751 microversion: 2.1 time: 0.168129 Aug 01 14:14:03.237530 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 357/721] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:03 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:04.060306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:04.061056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:04.068010 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:04.068500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:04.069270 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:04.069707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:04.205486 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:04.214706 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:04.216225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:04.217398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2ff972e9-1eed-4237-ad52-069062bca8ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.161040 Aug 01 14:14:04.217958 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 365/722] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:04 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:04.263614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9df289fa-bf69-45ed-814d-5a6a1f94a065 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:04.274167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9df289fa-bf69-45ed-814d-5a6a1f94a065 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:04.280494 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9df289fa-bf69-45ed-814d-5a6a1f94a065 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:04.280945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9df289fa-bf69-45ed-814d-5a6a1f94a065 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:04.281712 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9df289fa-bf69-45ed-814d-5a6a1f94a065 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:04.282141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9df289fa-bf69-45ed-814d-5a6a1f94a065 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:04.421256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9df289fa-bf69-45ed-814d-5a6a1f94a065 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:04.429538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9df289fa-bf69-45ed-814d-5a6a1f94a065 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1751 microversion: 2.1 time: 0.174994 Aug 01 14:14:04.430097 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 358/723] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:04 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:05.240353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:05.240990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:05.247411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:05.247857 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:05.248637 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:05.249068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:05.379539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:05.387944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:05.389478 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:05.390676 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3a993031-35ff-4444-b426-307a4ae0bafd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.154230 Aug 01 14:14:05.391243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 366/724] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:05 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:05.451093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-47f85758-ce7a-45d8-a241-b9d69c0f50ab tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:05.451709 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-47f85758-ce7a-45d8-a241-b9d69c0f50ab tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:05.459113 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-47f85758-ce7a-45d8-a241-b9d69c0f50ab tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:05.459565 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-47f85758-ce7a-45d8-a241-b9d69c0f50ab tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:05.460357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-47f85758-ce7a-45d8-a241-b9d69c0f50ab tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:05.460829 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-47f85758-ce7a-45d8-a241-b9d69c0f50ab tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:05.603588 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-47f85758-ce7a-45d8-a241-b9d69c0f50ab tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:05.611706 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-47f85758-ce7a-45d8-a241-b9d69c0f50ab tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1751 microversion: 2.1 time: 0.164400 Aug 01 14:14:05.612459 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 359/725] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:05 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:06.414834 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:06.415231 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:06.421574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:06.422029 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:06.422846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:06.423284 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:06.552835 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:06.561084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:06.562580 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:06.563726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e830ac4c-0023-45b5-b9f1-bf92ca2fe674 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1810 microversion: 2.20 time: 0.153857 Aug 01 14:14:06.564280 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 367/726] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:06 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:14:06.634197 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9b3506f8-6184-4e20-a458-578b3c9704f4 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:06.634803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9b3506f8-6184-4e20-a458-578b3c9704f4 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:06.641224 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9b3506f8-6184-4e20-a458-578b3c9704f4 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:06.641666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9b3506f8-6184-4e20-a458-578b3c9704f4 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:06.642414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9b3506f8-6184-4e20-a458-578b3c9704f4 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:06.642842 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9b3506f8-6184-4e20-a458-578b3c9704f4 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:06.794905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9b3506f8-6184-4e20-a458-578b3c9704f4 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:06.803214 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9b3506f8-6184-4e20-a458-578b3c9704f4 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.172573 Aug 01 14:14:06.803785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 360/727] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:06 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:07.586061 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:07.586667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:07.593187 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.593641 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.594397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.594829 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.728602 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:07.737219 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:07.739269 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:07.740438 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-999a7c28-e0bf-4d84-8d9b-1feb55c81fc4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1797 microversion: 2.20 time: 0.158238 Aug 01 14:14:07.741054 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 368/728] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:14:07 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1797 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:14:07.824620 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-968da11f-6945-4c1b-93f2-8ee004be9fa0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:07.825251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-968da11f-6945-4c1b-93f2-8ee004be9fa0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:07.832012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-968da11f-6945-4c1b-93f2-8ee004be9fa0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.832460 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-968da11f-6945-4c1b-93f2-8ee004be9fa0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.833243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-968da11f-6945-4c1b-93f2-8ee004be9fa0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:07.833674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-968da11f-6945-4c1b-93f2-8ee004be9fa0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:07.973810 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-968da11f-6945-4c1b-93f2-8ee004be9fa0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:07.982452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-968da11f-6945-4c1b-93f2-8ee004be9fa0 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.161717 Aug 01 14:14:07.983020 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 361/729] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:07 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:08.003216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-73261bd2-f28c-460e-9829-b72d9dc1354a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:08.003708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-73261bd2-f28c-460e-9829-b72d9dc1354a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:08.009770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73261bd2-f28c-460e-9829-b72d9dc1354a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:08.010225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73261bd2-f28c-460e-9829-b72d9dc1354a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:08.010983 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73261bd2-f28c-460e-9829-b72d9dc1354a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:08.011419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73261bd2-f28c-460e-9829-b72d9dc1354a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:08.128320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:08.136021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-73261bd2-f28c-460e-9829-b72d9dc1354a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lazy-loading 'services' on Instance uuid c5267261-9998-448b-98a6-26f44d18c68d {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:14:08.246550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-73261bd2-f28c-460e-9829-b72d9dc1354a tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d/os-volume_attachments/c4164fa3-15c9-4655-b0ed-b64bd8d6bc5b" status: 202 len: 0 microversion: 2.1 time: 0.247422 Aug 01 14:14:08.247239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 369/730] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:14:07 2022] DELETE /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d/os-volume_attachments/c4164fa3-15c9-4655-b0ed-b64bd8d6bc5b => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:14:09.005171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f7f38be4-9c28-41fc-ae11-84c33d98bb25 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:09.005794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f7f38be4-9c28-41fc-ae11-84c33d98bb25 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:09.015731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7f38be4-9c28-41fc-ae11-84c33d98bb25 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:09.016186 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7f38be4-9c28-41fc-ae11-84c33d98bb25 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:09.017692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7f38be4-9c28-41fc-ae11-84c33d98bb25 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:09.018139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f7f38be4-9c28-41fc-ae11-84c33d98bb25 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:09.162069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f7f38be4-9c28-41fc-ae11-84c33d98bb25 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:09.170167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f7f38be4-9c28-41fc-ae11-84c33d98bb25 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.169451 Aug 01 14:14:09.170731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 362/731] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:08 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:09.294605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:14:09.294839 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Mon Aug 1 14:14:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:14:10.192665 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d5a44c78-bc4a-47df-aaf4-032a9d5f198c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:10.193372 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d5a44c78-bc4a-47df-aaf4-032a9d5f198c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:10.200164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5a44c78-bc4a-47df-aaf4-032a9d5f198c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:10.200649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5a44c78-bc4a-47df-aaf4-032a9d5f198c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:10.201434 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5a44c78-bc4a-47df-aaf4-032a9d5f198c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:10.201856 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5a44c78-bc4a-47df-aaf4-032a9d5f198c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:10.342178 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d5a44c78-bc4a-47df-aaf4-032a9d5f198c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:10.350587 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d5a44c78-bc4a-47df-aaf4-032a9d5f198c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.163076 Aug 01 14:14:10.351159 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 370/732] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:10 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:10.429477 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1cf787a9-666a-4dfd-8897-8fab3c7a880e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:10.430013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1cf787a9-666a-4dfd-8897-8fab3c7a880e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:10.437269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cf787a9-666a-4dfd-8897-8fab3c7a880e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:10.437716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cf787a9-666a-4dfd-8897-8fab3c7a880e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:10.438476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cf787a9-666a-4dfd-8897-8fab3c7a880e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:10.438917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cf787a9-666a-4dfd-8897-8fab3c7a880e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:10.464650 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1cf787a9-666a-4dfd-8897-8fab3c7a880e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:14:10.546797 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1cf787a9-666a-4dfd-8897-8fab3c7a880e tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 204 len: 0 microversion: 2.1 time: 0.120785 Aug 01 14:14:10.547678 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 363/733] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:14:10 2022] DELETE /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:14:10.555801 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2dbf0fbb-72a6-4e6e-beb7-46ed817d08be tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:10.556410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2dbf0fbb-72a6-4e6e-beb7-46ed817d08be tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:10.562505 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2dbf0fbb-72a6-4e6e-beb7-46ed817d08be tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:10.562948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2dbf0fbb-72a6-4e6e-beb7-46ed817d08be tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:10.563693 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2dbf0fbb-72a6-4e6e-beb7-46ed817d08be tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:10.564123 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2dbf0fbb-72a6-4e6e-beb7-46ed817d08be tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:10.694452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2dbf0fbb-72a6-4e6e-beb7-46ed817d08be tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:10.701783 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2dbf0fbb-72a6-4e6e-beb7-46ed817d08be tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1511 microversion: 2.1 time: 0.149780 Aug 01 14:14:10.702351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 371/734] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:10 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:11.371553 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4329e484-74e6-480c-9b27-0ef7bea363bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:11.372246 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4329e484-74e6-480c-9b27-0ef7bea363bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:11.378230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4329e484-74e6-480c-9b27-0ef7bea363bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:11.378669 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4329e484-74e6-480c-9b27-0ef7bea363bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:11.379415 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4329e484-74e6-480c-9b27-0ef7bea363bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:11.379842 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4329e484-74e6-480c-9b27-0ef7bea363bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:11.526121 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4329e484-74e6-480c-9b27-0ef7bea363bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:11.534540 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4329e484-74e6-480c-9b27-0ef7bea363bb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.167064 Aug 01 14:14:11.535826 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 364/735] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:11 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:11.724192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-031f3ed1-27f0-460c-b834-b96818f08c35 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:11.724862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-031f3ed1-27f0-460c-b834-b96818f08c35 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:11.731382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-031f3ed1-27f0-460c-b834-b96818f08c35 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:11.731831 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-031f3ed1-27f0-460c-b834-b96818f08c35 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:11.732630 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-031f3ed1-27f0-460c-b834-b96818f08c35 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:11.733067 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-031f3ed1-27f0-460c-b834-b96818f08c35 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:11.863994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-031f3ed1-27f0-460c-b834-b96818f08c35 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:11.871423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-031f3ed1-27f0-460c-b834-b96818f08c35 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1511 microversion: 2.1 time: 0.151098 Aug 01 14:14:11.871994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 372/736] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:11 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1511 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:12.557163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-877ffc7e-52e4-4902-91eb-1df19b5e57ad tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:12.557768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-877ffc7e-52e4-4902-91eb-1df19b5e57ad tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:12.564103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-877ffc7e-52e4-4902-91eb-1df19b5e57ad tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:12.564579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-877ffc7e-52e4-4902-91eb-1df19b5e57ad tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:12.565336 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-877ffc7e-52e4-4902-91eb-1df19b5e57ad tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:12.565766 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-877ffc7e-52e4-4902-91eb-1df19b5e57ad tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:12.717999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-877ffc7e-52e4-4902-91eb-1df19b5e57ad tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:12.727389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-877ffc7e-52e4-4902-91eb-1df19b5e57ad tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.173880 Aug 01 14:14:12.728188 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 365/737] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:12 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:12.893334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5dd4ea23-9876-429f-bea3-41f7e3763415 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:12.893978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5dd4ea23-9876-429f-bea3-41f7e3763415 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:12.900417 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5dd4ea23-9876-429f-bea3-41f7e3763415 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:12.900901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5dd4ea23-9876-429f-bea3-41f7e3763415 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:12.901666 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5dd4ea23-9876-429f-bea3-41f7e3763415 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:12.902109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5dd4ea23-9876-429f-bea3-41f7e3763415 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:13.039103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5dd4ea23-9876-429f-bea3-41f7e3763415 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d54f339d88a4f8c9ef914497ce3138d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99a2e6e5b9974029a065bd70058dc8be', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:13.046715 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5dd4ea23-9876-429f-bea3-41f7e3763415 tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 200 len: 1511 microversion: 2.1 time: 0.157174 Aug 01 14:14:13.047294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 373/738] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:12 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:13.275326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-84358cc7-1aa2-4059-a183-ec1967f55b1c req-d794a1ae-8326-449b-8576-e119ddc67ebd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5267261-9998-448b-98a6-26f44d18c68d", "name": "network-vif-deleted", "tag": "3a4ba916-33f4-4318-9afe-1d671481726f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:13.285700 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-84358cc7-1aa2-4059-a183-ec1967f55b1c req-d794a1ae-8326-449b-8576-e119ddc67ebd service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:13.286145 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-84358cc7-1aa2-4059-a183-ec1967f55b1c req-d794a1ae-8326-449b-8576-e119ddc67ebd service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:13.296860 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-84358cc7-1aa2-4059-a183-ec1967f55b1c req-d794a1ae-8326-449b-8576-e119ddc67ebd service nova] Creating event network-vif-deleted:3a4ba916-33f4-4318-9afe-1d671481726f for instance c5267261-9998-448b-98a6-26f44d18c68d on hv-cinder-84713 Aug 01 14:14:13.301673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-84358cc7-1aa2-4059-a183-ec1967f55b1c req-d794a1ae-8326-449b-8576-e119ddc67ebd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029982 Aug 01 14:14:13.302259 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 366/739] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:13.749658 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d2c25e11-ebc7-4abd-9f9f-8b0086cdf270 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:13.750272 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d2c25e11-ebc7-4abd-9f9f-8b0086cdf270 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:13.756773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2c25e11-ebc7-4abd-9f9f-8b0086cdf270 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:13.757225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2c25e11-ebc7-4abd-9f9f-8b0086cdf270 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:13.758017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2c25e11-ebc7-4abd-9f9f-8b0086cdf270 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:13.758460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2c25e11-ebc7-4abd-9f9f-8b0086cdf270 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:13.904438 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d2c25e11-ebc7-4abd-9f9f-8b0086cdf270 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:13.912747 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d2c25e11-ebc7-4abd-9f9f-8b0086cdf270 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.166883 Aug 01 14:14:13.913320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 374/740] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:13 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:14.070829 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:14.071565 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] [instance: c5267261-9998-448b-98a6-26f44d18c68d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:14.077766 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:14.078220 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:14.078985 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:14.079422 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:14.092573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] HTTP exception thrown: Instance c5267261-9998-448b-98a6-26f44d18c68d could not be found. Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Request method failure captured: Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d HTTP/1.1 Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi597zY6gCgxTsmn4TtMDoHDNqAK7IYB7tj8rgBrRwjCeUwTpeauguJcm1pS2K7NQtqt1QtKyajfoqv8jNN4IQ6sDfwl-3GSCSMQPUT5Q2Gp-Xv4YN4qNzw0-Yz37KmzM_qNQK8YRNM0spF6dPFp1Im92u7jfRWTc3JqLAB1od2U7_PRA Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 99a2e6e5b9974029a065bd70058dc8be Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1809679751 Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:14:14.094161 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/99a2e6e5b9974029a065bd70058dc8be"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/99a2e6e5b9974029a065bd70058dc8be"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_99a2e6e5b9974029a065bd70058dc8be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/99a2e6e5b9974029a065bd70058dc8be"}]}] Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotTestJSON-1809679751 Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 99a2e6e5b9974029a065bd70058dc8be Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1809679751 Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotTestJSON-1809679751-project Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 1d54f339d88a4f8c9ef914497ce3138d Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotTestJSON-1809679751-project Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance c5267261-9998-448b-98a6-26f44d18c68d could not be found. Aug 01 14:14:14.095664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'c5267261-9998-448b-98a6-26f44d18c68d'} Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5267261-9998-448b-98a6-26f44d18c68d could not be found. Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:14:14.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5267261-9998-448b-98a6-26f44d18c68d could not be found. Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5267261-9998-448b-98a6-26f44d18c68d could not be found. Aug 01 14:14:14.097915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:14:14.099182 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] Returning 404 to user: Instance c5267261-9998-448b-98a6-26f44d18c68d could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:14:14.099182 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c0e61a4f-1c7f-462d-ba8f-784a144f6ebc tempest-VolumesSnapshotTestJSON-1809679751 tempest-VolumesSnapshotTestJSON-1809679751-project] 10.222.0.48 "GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d" status: 404 len: 111 microversion: 2.1 time: 0.030111 Aug 01 14:14:14.099182 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 367/741] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:14 2022] GET /compute/v2.1/servers/c5267261-9998-448b-98a6-26f44d18c68d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:14:14.936255 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4713d930-364d-438e-9a38-890d73a3d483 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:14.936896 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4713d930-364d-438e-9a38-890d73a3d483 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:14.943352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4713d930-364d-438e-9a38-890d73a3d483 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:14.943803 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4713d930-364d-438e-9a38-890d73a3d483 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:14.944604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4713d930-364d-438e-9a38-890d73a3d483 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:14.945047 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4713d930-364d-438e-9a38-890d73a3d483 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:15.084243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4713d930-364d-438e-9a38-890d73a3d483 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:15.093798 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4713d930-364d-438e-9a38-890d73a3d483 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.161042 Aug 01 14:14:15.094853 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 375/742] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:14 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:16.116232 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2d900719-aabe-494a-bf8b-bca21de986ef tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:16.116823 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2d900719-aabe-494a-bf8b-bca21de986ef tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:16.123326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d900719-aabe-494a-bf8b-bca21de986ef tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:16.123776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d900719-aabe-494a-bf8b-bca21de986ef tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:16.124571 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d900719-aabe-494a-bf8b-bca21de986ef tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:16.125012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d900719-aabe-494a-bf8b-bca21de986ef tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:16.270252 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2d900719-aabe-494a-bf8b-bca21de986ef tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:16.278302 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2d900719-aabe-494a-bf8b-bca21de986ef tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.167061 Aug 01 14:14:16.278863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 368/743] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:16 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:17.299278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-44915f1c-1bbc-4a6f-96a7-08af642660cb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:17.299914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-44915f1c-1bbc-4a6f-96a7-08af642660cb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:17.306490 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-44915f1c-1bbc-4a6f-96a7-08af642660cb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:17.306938 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-44915f1c-1bbc-4a6f-96a7-08af642660cb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:17.307697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-44915f1c-1bbc-4a6f-96a7-08af642660cb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:17.308131 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-44915f1c-1bbc-4a6f-96a7-08af642660cb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:17.454807 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-44915f1c-1bbc-4a6f-96a7-08af642660cb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:17.463316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-44915f1c-1bbc-4a6f-96a7-08af642660cb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.167935 Aug 01 14:14:17.463895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 376/744] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:17 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:18.485391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1b39c707-a900-451c-81b2-e0fcd9fb860b tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:18.486006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1b39c707-a900-451c-81b2-e0fcd9fb860b tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:18.492523 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b39c707-a900-451c-81b2-e0fcd9fb860b tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:18.493008 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b39c707-a900-451c-81b2-e0fcd9fb860b tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:18.493771 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b39c707-a900-451c-81b2-e0fcd9fb860b tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:18.494208 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b39c707-a900-451c-81b2-e0fcd9fb860b tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:18.631819 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1b39c707-a900-451c-81b2-e0fcd9fb860b tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:18.639723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1b39c707-a900-451c-81b2-e0fcd9fb860b tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.158156 Aug 01 14:14:18.640288 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 369/745] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:18 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:19.660993 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c5dcdbe0-87cf-4fe6-a093-a273b8db962d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:19.661612 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c5dcdbe0-87cf-4fe6-a093-a273b8db962d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:19.668121 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c5dcdbe0-87cf-4fe6-a093-a273b8db962d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:19.668682 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c5dcdbe0-87cf-4fe6-a093-a273b8db962d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:19.669452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c5dcdbe0-87cf-4fe6-a093-a273b8db962d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:19.669894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c5dcdbe0-87cf-4fe6-a093-a273b8db962d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:19.810446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c5dcdbe0-87cf-4fe6-a093-a273b8db962d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:19.819177 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c5dcdbe0-87cf-4fe6-a093-a273b8db962d tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.161972 Aug 01 14:14:19.819754 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 377/746] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:19 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:14:20.840758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f1e24a22-96c6-4abb-9eb2-16dd7b06df2a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:20.841379 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f1e24a22-96c6-4abb-9eb2-16dd7b06df2a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:20.848074 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1e24a22-96c6-4abb-9eb2-16dd7b06df2a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:20.849092 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1e24a22-96c6-4abb-9eb2-16dd7b06df2a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:20.849861 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1e24a22-96c6-4abb-9eb2-16dd7b06df2a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:20.850298 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f1e24a22-96c6-4abb-9eb2-16dd7b06df2a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:21.004025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f1e24a22-96c6-4abb-9eb2-16dd7b06df2a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:21.014628 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f1e24a22-96c6-4abb-9eb2-16dd7b06df2a tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.177725 Aug 01 14:14:21.029633 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 370/747] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:20 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:22.037853 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c0fef873-8be0-41e7-8f25-79c82d698ba9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:22.038472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c0fef873-8be0-41e7-8f25-79c82d698ba9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:22.045080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c0fef873-8be0-41e7-8f25-79c82d698ba9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:22.045533 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c0fef873-8be0-41e7-8f25-79c82d698ba9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:22.046296 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c0fef873-8be0-41e7-8f25-79c82d698ba9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:22.046731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c0fef873-8be0-41e7-8f25-79c82d698ba9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:22.190583 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c0fef873-8be0-41e7-8f25-79c82d698ba9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:22.199183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c0fef873-8be0-41e7-8f25-79c82d698ba9 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1756 microversion: 2.1 time: 0.165800 Aug 01 14:14:22.199767 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 378/748] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:22 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:14:23.221972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b4410a60-98a3-4f51-8944-f77abd233033 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:23.222586 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b4410a60-98a3-4f51-8944-f77abd233033 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:23.225553 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:23.231249 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4410a60-98a3-4f51-8944-f77abd233033 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:23.231707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4410a60-98a3-4f51-8944-f77abd233033 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:23.232473 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4410a60-98a3-4f51-8944-f77abd233033 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:23.232931 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4410a60-98a3-4f51-8944-f77abd233033 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:23.379988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4410a60-98a3-4f51-8944-f77abd233033 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:23.387913 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b4410a60-98a3-4f51-8944-f77abd233033 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1759 microversion: 2.1 time: 0.169776 Aug 01 14:14:23.388495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 371/749] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:23 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:35.840570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-085a2d91-117a-4f00-a311-5a3ba5ab283d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:35.841207 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-085a2d91-117a-4f00-a311-5a3ba5ab283d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:35.843834 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=41 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:35.844729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=58,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:35.850481 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-085a2d91-117a-4f00-a311-5a3ba5ab283d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:35.850980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-085a2d91-117a-4f00-a311-5a3ba5ab283d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:35.851756 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-085a2d91-117a-4f00-a311-5a3ba5ab283d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:35.852196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-085a2d91-117a-4f00-a311-5a3ba5ab283d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:35.877062 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-085a2d91-117a-4f00-a311-5a3ba5ab283d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/ips" status: 200 len: 145 microversion: 2.1 time: 0.040365 Aug 01 14:14:35.877639 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 379/750] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:14:35 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:40.099595 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-79ab620b-0506-490a-9ecf-256a841bf0f1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "214382c8-e3cc-4f81-ad08-64dba7a789db"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:40.101880 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-79ab620b-0506-490a-9ecf-256a841bf0f1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:40.104309 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:40.105123 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:40.110800 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79ab620b-0506-490a-9ecf-256a841bf0f1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:40.111241 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79ab620b-0506-490a-9ecf-256a841bf0f1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:40.111994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79ab620b-0506-490a-9ecf-256a841bf0f1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:40.112422 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-79ab620b-0506-490a-9ecf-256a841bf0f1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:40.389675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-79ab620b-0506-490a-9ecf-256a841bf0f1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294181 Aug 01 14:14:40.396270 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 372/751] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:14:40 2022] POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:43.233989 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-63872ee9-3ffe-43a2-9c4c-d38de252c506 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7522d5c9-586a-4490-8177-47524d0ea5ba"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:43.236380 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-63872ee9-3ffe-43a2-9c4c-d38de252c506 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:43.242376 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63872ee9-3ffe-43a2-9c4c-d38de252c506 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:43.242847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63872ee9-3ffe-43a2-9c4c-d38de252c506 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:43.243603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63872ee9-3ffe-43a2-9c4c-d38de252c506 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:43.244030 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63872ee9-3ffe-43a2-9c4c-d38de252c506 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:43.514379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-63872ee9-3ffe-43a2-9c4c-d38de252c506 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450438 Aug 01 14:14:43.515381 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 380/752] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:14:43 2022] POST /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments => generated 194 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:14:52.172845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-afa082d9-3f0c-420d-b99f-47bf324e3b7f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:14:52.175377 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:52.176034 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:52.182012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afa082d9-3f0c-420d-b99f-47bf324e3b7f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:52.182462 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afa082d9-3f0c-420d-b99f-47bf324e3b7f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:52.241367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-afa082d9-3f0c-420d-b99f-47bf324e3b7f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Going to try to stop instance {{(pid=117859) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 14:14:52.281506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-afa082d9-3f0c-420d-b99f-47bf324e3b7f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/action" status: 202 len: 0 microversion: 2.1 time: 0.112741 Aug 01 14:14:52.282162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 373/753] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:14:52 2022] POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:14:52.291265 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0401f979-fae8-4afe-a79f-f9b661dc8add tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:52.291964 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0401f979-fae8-4afe-a79f-f9b661dc8add tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:52.298785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0401f979-fae8-4afe-a79f-f9b661dc8add tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:52.299229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0401f979-fae8-4afe-a79f-f9b661dc8add tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:52.299980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0401f979-fae8-4afe-a79f-f9b661dc8add tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:52.300417 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0401f979-fae8-4afe-a79f-f9b661dc8add tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:52.431120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0401f979-fae8-4afe-a79f-f9b661dc8add tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:52.440381 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0401f979-fae8-4afe-a79f-f9b661dc8add tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.153209 Aug 01 14:14:52.440995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 381/754] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:52 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:53.462941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-acddedfa-f414-4e00-b12a-f88ef17376f7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:53.463651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-acddedfa-f414-4e00-b12a-f88ef17376f7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:53.469886 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-acddedfa-f414-4e00-b12a-f88ef17376f7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.470335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-acddedfa-f414-4e00-b12a-f88ef17376f7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.471134 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-acddedfa-f414-4e00-b12a-f88ef17376f7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:53.471573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-acddedfa-f414-4e00-b12a-f88ef17376f7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:53.602588 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-acddedfa-f414-4e00-b12a-f88ef17376f7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:53.610464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-acddedfa-f414-4e00-b12a-f88ef17376f7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.152280 Aug 01 14:14:53.611550 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 374/755] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:53 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:54.633581 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-30aa6bfd-4223-4ec2-9d63-6cea3e82304c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:54.634189 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-30aa6bfd-4223-4ec2-9d63-6cea3e82304c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:54.640737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30aa6bfd-4223-4ec2-9d63-6cea3e82304c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:54.641180 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30aa6bfd-4223-4ec2-9d63-6cea3e82304c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:54.641927 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30aa6bfd-4223-4ec2-9d63-6cea3e82304c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:54.642933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30aa6bfd-4223-4ec2-9d63-6cea3e82304c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:54.773436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-30aa6bfd-4223-4ec2-9d63-6cea3e82304c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:54.781431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-30aa6bfd-4223-4ec2-9d63-6cea3e82304c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.151642 Aug 01 14:14:54.782029 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 382/756] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:54 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:55.804032 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-58af8cdf-bf98-489c-b651-496d71d70887 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:55.804662 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-58af8cdf-bf98-489c-b651-496d71d70887 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:55.811036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-58af8cdf-bf98-489c-b651-496d71d70887 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:55.811476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-58af8cdf-bf98-489c-b651-496d71d70887 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:55.812229 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-58af8cdf-bf98-489c-b651-496d71d70887 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:55.812705 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-58af8cdf-bf98-489c-b651-496d71d70887 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:55.945370 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-58af8cdf-bf98-489c-b651-496d71d70887 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:55.953448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-58af8cdf-bf98-489c-b651-496d71d70887 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.153846 Aug 01 14:14:55.954011 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 375/757] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:55 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:56.975782 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8e7f62ae-4ac3-4f23-892b-85d2a28a77fc tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:56.976397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8e7f62ae-4ac3-4f23-892b-85d2a28a77fc tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:56.982927 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8e7f62ae-4ac3-4f23-892b-85d2a28a77fc tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:56.983384 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8e7f62ae-4ac3-4f23-892b-85d2a28a77fc tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:56.984198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8e7f62ae-4ac3-4f23-892b-85d2a28a77fc tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:56.984675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8e7f62ae-4ac3-4f23-892b-85d2a28a77fc tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:57.117702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8e7f62ae-4ac3-4f23-892b-85d2a28a77fc tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:57.125552 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8e7f62ae-4ac3-4f23-892b-85d2a28a77fc tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.153709 Aug 01 14:14:57.126120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 383/758] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:56 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:58.146573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-02de763e-c2e8-458a-a300-fe79728377e0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:58.147112 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-02de763e-c2e8-458a-a300-fe79728377e0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:58.153513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02de763e-c2e8-458a-a300-fe79728377e0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:58.153985 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02de763e-c2e8-458a-a300-fe79728377e0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:58.154736 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02de763e-c2e8-458a-a300-fe79728377e0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:58.155167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02de763e-c2e8-458a-a300-fe79728377e0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:58.278690 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02de763e-c2e8-458a-a300-fe79728377e0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:58.287178 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-02de763e-c2e8-458a-a300-fe79728377e0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.144532 Aug 01 14:14:58.287739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 376/759] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:58 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:14:59.307613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-206c996a-ecf9-40b2-b5ee-4ff90504b1d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:14:59.308332 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-206c996a-ecf9-40b2-b5ee-4ff90504b1d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:14:59.318057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-206c996a-ecf9-40b2-b5ee-4ff90504b1d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.318511 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-206c996a-ecf9-40b2-b5ee-4ff90504b1d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:59.319291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-206c996a-ecf9-40b2-b5ee-4ff90504b1d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:14:59.319726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-206c996a-ecf9-40b2-b5ee-4ff90504b1d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:14:59.456637 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-206c996a-ecf9-40b2-b5ee-4ff90504b1d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:14:59.464532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-206c996a-ecf9-40b2-b5ee-4ff90504b1d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.160737 Aug 01 14:14:59.465103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 384/760] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:14:59 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:00.486617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac15cc22-9c52-4576-a568-010da8bb1b56 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:00.487409 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ac15cc22-9c52-4576-a568-010da8bb1b56 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:00.493903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac15cc22-9c52-4576-a568-010da8bb1b56 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:00.494525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac15cc22-9c52-4576-a568-010da8bb1b56 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:00.495358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac15cc22-9c52-4576-a568-010da8bb1b56 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:00.495796 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac15cc22-9c52-4576-a568-010da8bb1b56 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:00.624333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ac15cc22-9c52-4576-a568-010da8bb1b56 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:00.633770 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ac15cc22-9c52-4576-a568-010da8bb1b56 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.150392 Aug 01 14:15:00.633770 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 377/761] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:00 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:01.655134 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-422f2a78-2220-4384-ae29-75728080867d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:01.655749 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-422f2a78-2220-4384-ae29-75728080867d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:01.662649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-422f2a78-2220-4384-ae29-75728080867d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:01.663106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-422f2a78-2220-4384-ae29-75728080867d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:01.663862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-422f2a78-2220-4384-ae29-75728080867d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:01.664294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-422f2a78-2220-4384-ae29-75728080867d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:01.790295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-422f2a78-2220-4384-ae29-75728080867d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:01.799239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-422f2a78-2220-4384-ae29-75728080867d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.147881 Aug 01 14:15:01.799841 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 385/762] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:01 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:02.824845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1912eb58-41bd-4bc8-9d64-00cfac96e496 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:02.824845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1912eb58-41bd-4bc8-9d64-00cfac96e496 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:02.832169 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1912eb58-41bd-4bc8-9d64-00cfac96e496 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:02.832654 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1912eb58-41bd-4bc8-9d64-00cfac96e496 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:02.833433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1912eb58-41bd-4bc8-9d64-00cfac96e496 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:02.833870 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1912eb58-41bd-4bc8-9d64-00cfac96e496 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:02.973780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1912eb58-41bd-4bc8-9d64-00cfac96e496 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:02.982146 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1912eb58-41bd-4bc8-9d64-00cfac96e496 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.164461 Aug 01 14:15:02.982714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 378/763] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:02 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:03.724758 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-56b0d272-85d2-4b2b-a8c1-78902e8225e0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:03.727016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-56b0d272-85d2-4b2b-a8c1-78902e8225e0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:03.733563 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56b0d272-85d2-4b2b-a8c1-78902e8225e0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:03.734011 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56b0d272-85d2-4b2b-a8c1-78902e8225e0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:03.734767 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56b0d272-85d2-4b2b-a8c1-78902e8225e0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:03.735240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56b0d272-85d2-4b2b-a8c1-78902e8225e0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:03.761597 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-56b0d272-85d2-4b2b-a8c1-78902e8225e0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lazy-loading 'flavor' on Instance uuid c9bc4793-88a4-4bc0-a99d-c5161e63842b {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:15:03.890689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-56b0d272-85d2-4b2b-a8c1-78902e8225e0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/action" status: 200 len: 32 microversion: 2.1 time: 0.169850 Aug 01 14:15:03.891942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 386/764] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:15:03 2022] POST /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/action => generated 32 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:15:03.903097 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-333f9bc2-1527-4f64-b07d-1f5391609bfb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:03.904185 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-333f9bc2-1527-4f64-b07d-1f5391609bfb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:03.913227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-333f9bc2-1527-4f64-b07d-1f5391609bfb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:03.913677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-333f9bc2-1527-4f64-b07d-1f5391609bfb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:03.914451 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-333f9bc2-1527-4f64-b07d-1f5391609bfb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:03.914884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-333f9bc2-1527-4f64-b07d-1f5391609bfb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.005622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-93d34e01-e0ab-46a2-9b62-117febd118ce tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:04.006335 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-93d34e01-e0ab-46a2-9b62-117febd118ce tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:04.012918 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93d34e01-e0ab-46a2-9b62-117febd118ce tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.013369 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93d34e01-e0ab-46a2-9b62-117febd118ce tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.014146 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93d34e01-e0ab-46a2-9b62-117febd118ce tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:04.014582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93d34e01-e0ab-46a2-9b62-117febd118ce tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:04.053251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-333f9bc2-1527-4f64-b07d-1f5391609bfb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:04.061452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-333f9bc2-1527-4f64-b07d-1f5391609bfb tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.163776 Aug 01 14:15:04.062036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 379/765] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:03 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:04.150151 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-93d34e01-e0ab-46a2-9b62-117febd118ce tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:04.158015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-93d34e01-e0ab-46a2-9b62-117febd118ce tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.157954 Aug 01 14:15:04.158581 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 387/766] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:03 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:05.084171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0d847e44-f2b9-4473-8e59-33b3d0fb11d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:05.084816 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0d847e44-f2b9-4473-8e59-33b3d0fb11d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:05.091257 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0d847e44-f2b9-4473-8e59-33b3d0fb11d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.091712 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0d847e44-f2b9-4473-8e59-33b3d0fb11d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.092502 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0d847e44-f2b9-4473-8e59-33b3d0fb11d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.092942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0d847e44-f2b9-4473-8e59-33b3d0fb11d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.179091 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-63c94ca8-c4df-494d-b06c-e4e3bee6afc2 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:05.179808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-63c94ca8-c4df-494d-b06c-e4e3bee6afc2 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:05.186085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63c94ca8-c4df-494d-b06c-e4e3bee6afc2 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.186531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63c94ca8-c4df-494d-b06c-e4e3bee6afc2 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.187294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63c94ca8-c4df-494d-b06c-e4e3bee6afc2 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:05.187723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-63c94ca8-c4df-494d-b06c-e4e3bee6afc2 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:05.316619 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-63c94ca8-c4df-494d-b06c-e4e3bee6afc2 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:05.317146 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0d847e44-f2b9-4473-8e59-33b3d0fb11d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:05.324987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-63c94ca8-c4df-494d-b06c-e4e3bee6afc2 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.149618 Aug 01 14:15:05.325754 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0d847e44-f2b9-4473-8e59-33b3d0fb11d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.245422 Aug 01 14:15:05.325903 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 388/767] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:05 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:05.326790 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 380/768] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:05 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:06.346967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1a635e3c-432a-4ac9-a728-6a1fcc7ac24c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:06.347534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-542b2e91-c411-47a2-9f38-7265cc5a1b83 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:06.347935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1a635e3c-432a-4ac9-a728-6a1fcc7ac24c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:06.348048 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-542b2e91-c411-47a2-9f38-7265cc5a1b83 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:06.350166 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=21 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:06.355030 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542b2e91-c411-47a2-9f38-7265cc5a1b83 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:06.355392 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1a635e3c-432a-4ac9-a728-6a1fcc7ac24c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:06.355519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542b2e91-c411-47a2-9f38-7265cc5a1b83 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:06.355849 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1a635e3c-432a-4ac9-a728-6a1fcc7ac24c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:06.356265 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542b2e91-c411-47a2-9f38-7265cc5a1b83 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:06.356656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1a635e3c-432a-4ac9-a728-6a1fcc7ac24c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:06.356768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-542b2e91-c411-47a2-9f38-7265cc5a1b83 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:06.357097 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1a635e3c-432a-4ac9-a728-6a1fcc7ac24c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:06.361728 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:06.490905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-542b2e91-c411-47a2-9f38-7265cc5a1b83 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:06.499090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-542b2e91-c411-47a2-9f38-7265cc5a1b83 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.155332 Aug 01 14:15:06.499675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 381/769] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:06 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:06.749332 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1a635e3c-432a-4ac9-a728-6a1fcc7ac24c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:06.757166 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1a635e3c-432a-4ac9-a728-6a1fcc7ac24c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.414026 Aug 01 14:15:06.757738 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 389/770] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:06 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:07.521691 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-95e3df15-ff38-4dbc-a327-ace7d499d505 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:07.522256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-95e3df15-ff38-4dbc-a327-ace7d499d505 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:07.528894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95e3df15-ff38-4dbc-a327-ace7d499d505 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:07.529339 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95e3df15-ff38-4dbc-a327-ace7d499d505 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:07.530096 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95e3df15-ff38-4dbc-a327-ace7d499d505 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:07.530534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95e3df15-ff38-4dbc-a327-ace7d499d505 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:07.657914 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-95e3df15-ff38-4dbc-a327-ace7d499d505 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:07.665654 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-95e3df15-ff38-4dbc-a327-ace7d499d505 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.147879 Aug 01 14:15:07.666210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 382/771] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:07 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:07.778089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4d9d20bb-35f8-4742-86db-271e70b43ae8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:07.778692 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4d9d20bb-35f8-4742-86db-271e70b43ae8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:07.785855 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d9d20bb-35f8-4742-86db-271e70b43ae8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:07.786507 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d9d20bb-35f8-4742-86db-271e70b43ae8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:07.787269 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d9d20bb-35f8-4742-86db-271e70b43ae8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:07.787704 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d9d20bb-35f8-4742-86db-271e70b43ae8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:07.921334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4d9d20bb-35f8-4742-86db-271e70b43ae8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:07.929623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4d9d20bb-35f8-4742-86db-271e70b43ae8 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.155284 Aug 01 14:15:07.930185 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 390/772] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:07 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:08.686267 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b12284bd-4b5f-4051-ba23-341ce740c829 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:08.686873 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b12284bd-4b5f-4051-ba23-341ce740c829 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:08.693526 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b12284bd-4b5f-4051-ba23-341ce740c829 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:08.693973 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b12284bd-4b5f-4051-ba23-341ce740c829 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:08.694726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b12284bd-4b5f-4051-ba23-341ce740c829 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:08.695155 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b12284bd-4b5f-4051-ba23-341ce740c829 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:08.835193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b12284bd-4b5f-4051-ba23-341ce740c829 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:08.843379 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b12284bd-4b5f-4051-ba23-341ce740c829 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.160811 Aug 01 14:15:08.843986 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 383/773] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:08 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:08.951512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d859ffa9-0727-4370-b499-0859c2df0099 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:08.952510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d859ffa9-0727-4370-b499-0859c2df0099 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:08.959490 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d859ffa9-0727-4370-b499-0859c2df0099 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:08.960052 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d859ffa9-0727-4370-b499-0859c2df0099 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:08.960842 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d859ffa9-0727-4370-b499-0859c2df0099 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:08.961276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d859ffa9-0727-4370-b499-0859c2df0099 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:09.103201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d859ffa9-0727-4370-b499-0859c2df0099 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:09.111269 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d859ffa9-0727-4370-b499-0859c2df0099 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.163916 Aug 01 14:15:09.111908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 391/774] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:08 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:09.864886 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cc09320d-5a90-414c-bfba-1e6bc8337a9c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:09.865465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cc09320d-5a90-414c-bfba-1e6bc8337a9c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:09.872431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cc09320d-5a90-414c-bfba-1e6bc8337a9c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:09.872904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cc09320d-5a90-414c-bfba-1e6bc8337a9c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:09.873976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cc09320d-5a90-414c-bfba-1e6bc8337a9c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:09.874415 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cc09320d-5a90-414c-bfba-1e6bc8337a9c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:10.070117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cc09320d-5a90-414c-bfba-1e6bc8337a9c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:10.083316 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cc09320d-5a90-414c-bfba-1e6bc8337a9c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1723 microversion: 2.1 time: 0.222307 Aug 01 14:15:10.084875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 384/775] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:09 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:10.133425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f858dba6-7ef5-4fe9-a830-7e479ec47d27 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:10.134088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f858dba6-7ef5-4fe9-a830-7e479ec47d27 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:10.142789 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f858dba6-7ef5-4fe9-a830-7e479ec47d27 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:10.147779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f858dba6-7ef5-4fe9-a830-7e479ec47d27 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:10.148777 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f858dba6-7ef5-4fe9-a830-7e479ec47d27 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:10.149328 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f858dba6-7ef5-4fe9-a830-7e479ec47d27 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:10.316764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f858dba6-7ef5-4fe9-a830-7e479ec47d27 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:10.326020 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f858dba6-7ef5-4fe9-a830-7e479ec47d27 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.196561 Aug 01 14:15:10.327245 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 392/776] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:10 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:11.111047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9ac72eeb-89de-495e-91ec-904e3db6fb5e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:11.111653 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9ac72eeb-89de-495e-91ec-904e3db6fb5e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:11.118463 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ac72eeb-89de-495e-91ec-904e3db6fb5e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.118920 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ac72eeb-89de-495e-91ec-904e3db6fb5e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.119698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ac72eeb-89de-495e-91ec-904e3db6fb5e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.120132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ac72eeb-89de-495e-91ec-904e3db6fb5e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.321232 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9ac72eeb-89de-495e-91ec-904e3db6fb5e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:11.330044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9ac72eeb-89de-495e-91ec-904e3db6fb5e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1700 microversion: 2.1 time: 0.224137 Aug 01 14:15:11.330677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 385/777] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:11 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1700 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:11.350338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-11fa3d3e-1f31-4ebe-b73b-d5bd1a17789f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:11.351032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-11fa3d3e-1f31-4ebe-b73b-d5bd1a17789f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:11.353899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c7e71b31-349c-4967-b3d9-4ff52081873d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:11.360611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c7e71b31-349c-4967-b3d9-4ff52081873d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.361055 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c7e71b31-349c-4967-b3d9-4ff52081873d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.361867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11fa3d3e-1f31-4ebe-b73b-d5bd1a17789f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.362906 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11fa3d3e-1f31-4ebe-b73b-d5bd1a17789f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.365768 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11fa3d3e-1f31-4ebe-b73b-d5bd1a17789f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.366431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11fa3d3e-1f31-4ebe-b73b-d5bd1a17789f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.390219 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c7e71b31-349c-4967-b3d9-4ff52081873d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Going to try to start instance {{(pid=117859) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 14:15:11.454013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c7e71b31-349c-4967-b3d9-4ff52081873d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/action" status: 202 len: 0 microversion: 2.1 time: 0.103794 Aug 01 14:15:11.458596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 386/778] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:15:11 2022] POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:15:11.471431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f05cd05f-0b0a-46a2-8fd0-88148cc404a3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:11.472223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f05cd05f-0b0a-46a2-8fd0-88148cc404a3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:11.479565 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f05cd05f-0b0a-46a2-8fd0-88148cc404a3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.479968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f05cd05f-0b0a-46a2-8fd0-88148cc404a3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.480856 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f05cd05f-0b0a-46a2-8fd0-88148cc404a3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:11.481541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f05cd05f-0b0a-46a2-8fd0-88148cc404a3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:11.521714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:11.578968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-11fa3d3e-1f31-4ebe-b73b-d5bd1a17789f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:11.588050 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-11fa3d3e-1f31-4ebe-b73b-d5bd1a17789f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.241513 Aug 01 14:15:11.601128 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 393/779] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:11 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:11.883065 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f05cd05f-0b0a-46a2-8fd0-88148cc404a3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:11.894021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f05cd05f-0b0a-46a2-8fd0-88148cc404a3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1709 microversion: 2.1 time: 0.433855 Aug 01 14:15:11.894616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 387/780] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:11 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1709 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:12.609853 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-92cb0c47-c924-4922-a22b-c1af1d0dfe7f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:12.611079 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-92cb0c47-c924-4922-a22b-c1af1d0dfe7f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:12.617862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92cb0c47-c924-4922-a22b-c1af1d0dfe7f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:12.618701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92cb0c47-c924-4922-a22b-c1af1d0dfe7f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:12.619564 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92cb0c47-c924-4922-a22b-c1af1d0dfe7f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:12.620098 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92cb0c47-c924-4922-a22b-c1af1d0dfe7f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:12.763660 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-92cb0c47-c924-4922-a22b-c1af1d0dfe7f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:12.772373 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-92cb0c47-c924-4922-a22b-c1af1d0dfe7f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.166893 Aug 01 14:15:12.774986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 394/781] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:12 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:12.915738 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-713744c8-1a01-433b-b9fb-dc8dc400a696 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:12.917635 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-713744c8-1a01-433b-b9fb-dc8dc400a696 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:12.924457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-713744c8-1a01-433b-b9fb-dc8dc400a696 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:12.925014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-713744c8-1a01-433b-b9fb-dc8dc400a696 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:12.926009 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-713744c8-1a01-433b-b9fb-dc8dc400a696 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:12.926522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-713744c8-1a01-433b-b9fb-dc8dc400a696 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.189251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-713744c8-1a01-433b-b9fb-dc8dc400a696 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:13.211378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-713744c8-1a01-433b-b9fb-dc8dc400a696 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1709 microversion: 2.1 time: 0.298893 Aug 01 14:15:13.212220 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 388/782] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:12 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1709 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:13.795136 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-cd363ee4-00f7-4930-aae7-df56a45e89c0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:13.796466 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-cd363ee4-00f7-4930-aae7-df56a45e89c0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:13.804246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd363ee4-00f7-4930-aae7-df56a45e89c0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:13.804742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd363ee4-00f7-4930-aae7-df56a45e89c0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.805522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd363ee4-00f7-4930-aae7-df56a45e89c0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:13.806145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd363ee4-00f7-4930-aae7-df56a45e89c0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:13.977346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-cd363ee4-00f7-4930-aae7-df56a45e89c0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:13.989617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-cd363ee4-00f7-4930-aae7-df56a45e89c0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.199343 Aug 01 14:15:13.990648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 395/783] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:13 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:14.236044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ec80970b-c824-4efe-8417-9abf07cad247 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:14.236697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ec80970b-c824-4efe-8417-9abf07cad247 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:14.244506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ec80970b-c824-4efe-8417-9abf07cad247 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:14.244968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ec80970b-c824-4efe-8417-9abf07cad247 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:14.245757 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ec80970b-c824-4efe-8417-9abf07cad247 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:14.246398 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ec80970b-c824-4efe-8417-9abf07cad247 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:14.409559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ec80970b-c824-4efe-8417-9abf07cad247 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:14.423553 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ec80970b-c824-4efe-8417-9abf07cad247 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1709 microversion: 2.1 time: 0.192867 Aug 01 14:15:14.424496 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 389/784] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:14 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1709 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:15.023486 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e7590447-f670-4f73-953b-1482891c0ca0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:15.024102 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e7590447-f670-4f73-953b-1482891c0ca0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:15.031382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e7590447-f670-4f73-953b-1482891c0ca0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.032099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e7590447-f670-4f73-953b-1482891c0ca0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.033192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e7590447-f670-4f73-953b-1482891c0ca0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.033845 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e7590447-f670-4f73-953b-1482891c0ca0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.211873 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e7590447-f670-4f73-953b-1482891c0ca0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:15.222582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e7590447-f670-4f73-953b-1482891c0ca0 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.203758 Aug 01 14:15:15.223553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 396/785] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:15 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:15.455092 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-73b3fd5d-bb7c-4b1d-b894-4570141dee97 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:15.457789 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-73b3fd5d-bb7c-4b1d-b894-4570141dee97 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:15.484212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73b3fd5d-bb7c-4b1d-b894-4570141dee97 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.485524 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73b3fd5d-bb7c-4b1d-b894-4570141dee97 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.488867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73b3fd5d-bb7c-4b1d-b894-4570141dee97 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:15.489501 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73b3fd5d-bb7c-4b1d-b894-4570141dee97 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:15.749136 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-73b3fd5d-bb7c-4b1d-b894-4570141dee97 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:15.762099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-73b3fd5d-bb7c-4b1d-b894-4570141dee97 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1713 microversion: 2.1 time: 0.317612 Aug 01 14:15:15.763055 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 390/786] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:15 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1713 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:16.246539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-420aa6d6-ed43-4aef-b85c-92c4795517bd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:16.247448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-420aa6d6-ed43-4aef-b85c-92c4795517bd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:16.254950 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-420aa6d6-ed43-4aef-b85c-92c4795517bd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:16.255492 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-420aa6d6-ed43-4aef-b85c-92c4795517bd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:16.256333 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-420aa6d6-ed43-4aef-b85c-92c4795517bd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:16.256885 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-420aa6d6-ed43-4aef-b85c-92c4795517bd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:16.396143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-420aa6d6-ed43-4aef-b85c-92c4795517bd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:16.407714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-420aa6d6-ed43-4aef-b85c-92c4795517bd tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.165320 Aug 01 14:15:16.408474 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 397/787] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:16 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:17.430096 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-07d4a92c-4ef0-430a-8560-87021fa713a4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:17.430635 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-07d4a92c-4ef0-430a-8560-87021fa713a4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:17.443380 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07d4a92c-4ef0-430a-8560-87021fa713a4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:17.443826 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07d4a92c-4ef0-430a-8560-87021fa713a4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:17.444631 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07d4a92c-4ef0-430a-8560-87021fa713a4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:17.447740 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07d4a92c-4ef0-430a-8560-87021fa713a4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:17.604127 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-07d4a92c-4ef0-430a-8560-87021fa713a4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:17.613462 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-07d4a92c-4ef0-430a-8560-87021fa713a4 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.187350 Aug 01 14:15:17.621680 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 391/788] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:17 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:18.635250 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-86e14b3c-7fcf-4cca-88fc-c5334192cee3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:18.635859 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-86e14b3c-7fcf-4cca-88fc-c5334192cee3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:18.642930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-86e14b3c-7fcf-4cca-88fc-c5334192cee3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:18.643386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-86e14b3c-7fcf-4cca-88fc-c5334192cee3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:18.644153 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-86e14b3c-7fcf-4cca-88fc-c5334192cee3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:18.644865 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-86e14b3c-7fcf-4cca-88fc-c5334192cee3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:18.860528 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-86e14b3c-7fcf-4cca-88fc-c5334192cee3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:18.869096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-86e14b3c-7fcf-4cca-88fc-c5334192cee3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.237575 Aug 01 14:15:18.884186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 398/789] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:18 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:19.272357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aa6f3c81-b995-4ff6-bd07-99b90180bb80 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Action: 'create', calling method: .version_select at 0x7f4462c294c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-922602789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHyrHzdO0HzjuZeioiaxogrKW3bhlCEm8b8obIvMA6HuCt96pmzKsiY5H9HV3i7bAcAy4BgtcHIYd4C6/z/k+g2W5mFlVXDyZlJykOxrbGRBquwIZOi+7laIdCs9lEMyaw=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:19.288623 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-aa6f3c81-b995-4ff6-bd07-99b90180bb80 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Getting quotas for project d11b6361110344b0a67b6b73ccc0c2f4. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:15:19.292546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-aa6f3c81-b995-4ff6-bd07-99b90180bb80 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Getting quotas for user 86cef19aed2a45fb87c30dbd2d422dae and project d11b6361110344b0a67b6b73ccc0c2f4. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:15:19.324601 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aa6f3c81-b995-4ff6-bd07-99b90180bb80 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.232822 Aug 01 14:15:19.331496 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 392/790] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:15:19 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:19.892063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1d15a25d-f4b0-4d60-82c4-fff4b6a61450 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:19.893412 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1d15a25d-f4b0-4d60-82c4-fff4b6a61450 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:19.899973 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1d15a25d-f4b0-4d60-82c4-fff4b6a61450 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:19.900425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1d15a25d-f4b0-4d60-82c4-fff4b6a61450 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:19.901246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1d15a25d-f4b0-4d60-82c4-fff4b6a61450 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:19.901691 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1d15a25d-f4b0-4d60-82c4-fff4b6a61450 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:20.068352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1d15a25d-f4b0-4d60-82c4-fff4b6a61450 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:20.077447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1d15a25d-f4b0-4d60-82c4-fff4b6a61450 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1737 microversion: 2.1 time: 0.189759 Aug 01 14:15:20.078103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 399/791] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:19 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1737 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:21.099944 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dca3241a-7f60-41e4-87ac-7608ba189c5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:21.100638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dca3241a-7f60-41e4-87ac-7608ba189c5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:21.107306 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dca3241a-7f60-41e4-87ac-7608ba189c5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.107776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dca3241a-7f60-41e4-87ac-7608ba189c5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.109210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dca3241a-7f60-41e4-87ac-7608ba189c5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.109672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dca3241a-7f60-41e4-87ac-7608ba189c5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.243074 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dca3241a-7f60-41e4-87ac-7608ba189c5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:21.251921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dca3241a-7f60-41e4-87ac-7608ba189c5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1717 microversion: 2.1 time: 0.156323 Aug 01 14:15:21.252693 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 393/792] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:21 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1717 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:21.371954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:21.372532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:21.378836 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.379285 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.380049 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.380511 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.469787 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] HTTP exception thrown: Cannot 'detach_volume' instance c9bc4793-88a4-4bc0-a99d-c5161e63842b while it is in vm_state rescued Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Request method failure captured: Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments/7522d5c9-586a-4490-8177-47524d0ea5ba HTTP/1.1 Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_QTP34zCqxkjuzGhNGLJjTdwR4Wdl9YtCoqvRiTXZc35VR0PDFWWOlwBCKUJQGjaghsULTBWYIDh0BETy4ucBH_XjPQZxYfXn1Z8Rmv0h464Jj2L3NqHAUmDGP6rXRjuKMfTyHWkpaKimc-w1uebscESmboyRMBjkIwxCdpVdxS0 Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:15:21.471484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}] Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: f379b005418a4e399c3b72cbbef6e00d Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:15:21.473088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Cannot 'detach_volume' instance c9bc4793-88a4-4bc0-a99d-c5161e63842b while it is in vm_state rescued Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'server_id': 'c9bc4793-88a4-4bc0-a99d-c5161e63842b', 'id': '7522d5c9-586a-4490-8177-47524d0ea5ba'} Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c9bc4793-88a4-4bc0-a99d-c5161e63842b in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:15:21.473788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c9bc4793-88a4-4bc0-a99d-c5161e63842b while it is in vm_state rescued Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c9bc4793-88a4-4bc0-a99d-c5161e63842b while it is in vm_state rescued Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:15:21.475276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Returning 409 to user: Cannot 'detach_volume' instance c9bc4793-88a4-4bc0-a99d-c5161e63842b while it is in vm_state rescued {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:15:21.476326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-76d1f59c-f11b-4506-adc0-a7114f36a86d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments/7522d5c9-586a-4490-8177-47524d0ea5ba" status: 409 len: 152 microversion: 2.1 time: 0.105074 Aug 01 14:15:21.476326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 400/793] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:15:21 2022] DELETE /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments/7522d5c9-586a-4490-8177-47524d0ea5ba => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 01 14:15:21.482077 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-27a44fc9-1c66-494c-8329-5b452be2dd21 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:21.482638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-27a44fc9-1c66-494c-8329-5b452be2dd21 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:21.488755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-27a44fc9-1c66-494c-8329-5b452be2dd21 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.489209 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-27a44fc9-1c66-494c-8329-5b452be2dd21 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.489973 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-27a44fc9-1c66-494c-8329-5b452be2dd21 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.490432 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-27a44fc9-1c66-494c-8329-5b452be2dd21 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.561367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-27a44fc9-1c66-494c-8329-5b452be2dd21 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "POST /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/action" status: 202 len: 0 microversion: 2.1 time: 0.082672 Aug 01 14:15:21.564762 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 394/794] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:15:21 2022] POST /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:15:21.571565 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b9577381-7d77-4421-834c-bd2938d303f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:21.572139 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b9577381-7d77-4421-834c-bd2938d303f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:21.579868 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b9577381-7d77-4421-834c-bd2938d303f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.580439 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b9577381-7d77-4421-834c-bd2938d303f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.581550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b9577381-7d77-4421-834c-bd2938d303f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:21.582149 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b9577381-7d77-4421-834c-bd2938d303f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:21.723187 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b9577381-7d77-4421-834c-bd2938d303f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:21.731370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b9577381-7d77-4421-834c-bd2938d303f3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1725 microversion: 2.1 time: 0.164993 Aug 01 14:15:21.732302 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 401/795] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:21 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:22.755816 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5cf11e1a-1430-4723-819e-5e692112b93e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:22.757295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5cf11e1a-1430-4723-819e-5e692112b93e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:22.759436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:22.775794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cf11e1a-1430-4723-819e-5e692112b93e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:22.776256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cf11e1a-1430-4723-819e-5e692112b93e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:22.777254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cf11e1a-1430-4723-819e-5e692112b93e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:22.777684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cf11e1a-1430-4723-819e-5e692112b93e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:22.949185 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5cf11e1a-1430-4723-819e-5e692112b93e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:22.965608 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5cf11e1a-1430-4723-819e-5e692112b93e tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1725 microversion: 2.1 time: 0.214589 Aug 01 14:15:22.966275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 395/796] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:22 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1725 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:23.987195 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-aac36102-784f-4a19-b48d-ad77bc1e99a3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:23.987809 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-aac36102-784f-4a19-b48d-ad77bc1e99a3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:23.995084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aac36102-784f-4a19-b48d-ad77bc1e99a3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:23.995536 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aac36102-784f-4a19-b48d-ad77bc1e99a3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:23.996301 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aac36102-784f-4a19-b48d-ad77bc1e99a3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:23.996771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aac36102-784f-4a19-b48d-ad77bc1e99a3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:24.128056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-aac36102-784f-4a19-b48d-ad77bc1e99a3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:24.136411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-aac36102-784f-4a19-b48d-ad77bc1e99a3 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1725 microversion: 2.1 time: 0.152923 Aug 01 14:15:24.137058 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 402/797] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:23 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:25.157215 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f342327d-7c0c-4faf-a91c-61d89d19313b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:25.157861 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f342327d-7c0c-4faf-a91c-61d89d19313b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:25.164691 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f342327d-7c0c-4faf-a91c-61d89d19313b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.165139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f342327d-7c0c-4faf-a91c-61d89d19313b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.165903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f342327d-7c0c-4faf-a91c-61d89d19313b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:25.166348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f342327d-7c0c-4faf-a91c-61d89d19313b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:25.299124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f342327d-7c0c-4faf-a91c-61d89d19313b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:25.307189 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f342327d-7c0c-4faf-a91c-61d89d19313b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1725 microversion: 2.1 time: 0.153904 Aug 01 14:15:25.307758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 396/798] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:25 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:26.330189 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4176a4fc-49db-46ca-affe-f3450f719aa6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:26.330708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4176a4fc-49db-46ca-affe-f3450f719aa6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:26.337254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4176a4fc-49db-46ca-affe-f3450f719aa6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:26.337706 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4176a4fc-49db-46ca-affe-f3450f719aa6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.338467 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4176a4fc-49db-46ca-affe-f3450f719aa6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:26.338903 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4176a4fc-49db-46ca-affe-f3450f719aa6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.471334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4176a4fc-49db-46ca-affe-f3450f719aa6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:26.479595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4176a4fc-49db-46ca-affe-f3450f719aa6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1731 microversion: 2.1 time: 0.154326 Aug 01 14:15:26.480159 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 403/799] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:26 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:26.507254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-567a4f3b-5665-483b-bbfd-ffbce8a5efe5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:26.507993 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-567a4f3b-5665-483b-bbfd-ffbce8a5efe5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:26.517709 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-567a4f3b-5665-483b-bbfd-ffbce8a5efe5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:26.518495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-567a4f3b-5665-483b-bbfd-ffbce8a5efe5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.519849 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-567a4f3b-5665-483b-bbfd-ffbce8a5efe5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:26.520646 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-567a4f3b-5665-483b-bbfd-ffbce8a5efe5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:26.603559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-567a4f3b-5665-483b-bbfd-ffbce8a5efe5 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103186 Aug 01 14:15:26.605005 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 397/800] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 14:15:26 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:27.563171 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-1a0baaf5-df2e-4ef1-84f3-edcbdf94c6a6 req-eaade718-46a5-4710-b8eb-37b043e767fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bc4793-88a4-4bc0-a99d-c5161e63842b", "tag": "95fff2c9-f9b3-439e-a613-9ea37938dcf9"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:27.572659 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-1a0baaf5-df2e-4ef1-84f3-edcbdf94c6a6 req-eaade718-46a5-4710-b8eb-37b043e767fb service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:27.573126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-1a0baaf5-df2e-4ef1-84f3-edcbdf94c6a6 req-eaade718-46a5-4710-b8eb-37b043e767fb service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:27.585175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-1a0baaf5-df2e-4ef1-84f3-edcbdf94c6a6 req-eaade718-46a5-4710-b8eb-37b043e767fb service nova] Creating event network-changed:95fff2c9-f9b3-439e-a613-9ea37938dcf9 for instance c9bc4793-88a4-4bc0-a99d-c5161e63842b on hv-cinder-84713 Aug 01 14:15:27.590350 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-1a0baaf5-df2e-4ef1-84f3-edcbdf94c6a6 req-eaade718-46a5-4710-b8eb-37b043e767fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101528 Aug 01 14:15:27.591129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 404/801] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:29.605228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:29.610803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-1f6302bb-981a-4b6b-bd33-61e878f99c74 req-7993df53-1273-4148-8223-0ddb5f105fac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bc4793-88a4-4bc0-a99d-c5161e63842b", "tag": "95fff2c9-f9b3-439e-a613-9ea37938dcf9"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:29.620525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1f6302bb-981a-4b6b-bd33-61e878f99c74 req-7993df53-1273-4148-8223-0ddb5f105fac service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:29.621414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1f6302bb-981a-4b6b-bd33-61e878f99c74 req-7993df53-1273-4148-8223-0ddb5f105fac service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:29.632979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-1f6302bb-981a-4b6b-bd33-61e878f99c74 req-7993df53-1273-4148-8223-0ddb5f105fac service nova] Creating event network-changed:95fff2c9-f9b3-439e-a613-9ea37938dcf9 for instance c9bc4793-88a4-4bc0-a99d-c5161e63842b on hv-cinder-84713 Aug 01 14:15:29.638119 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-1f6302bb-981a-4b6b-bd33-61e878f99c74 req-7993df53-1273-4148-8223-0ddb5f105fac service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034214 Aug 01 14:15:29.638737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 398/802] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:44.206771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:15:44.207330 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Mon Aug 1 14:15:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:15:45.123440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1831317813", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-922602789", "security_groups": [{"name": "tempest-secgroup-smoke-1872230483"}], "networks": [{"uuid": "8b2df44e-1b92-4283-bcb4-e7ee81af470d"}], "block_device_mapping_v2": [{"uuid": "6f4341d5-f97b-4bc3-97b8-bc752a7b1086", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:45.133821 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=31 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:45.134463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=91 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:45.173494 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=7 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:45.174440 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:45.243615 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] validate_networks() for [('8b2df44e-1b92-4283-bcb4-e7ee81af470d', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:15:45.275535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7b157772-cf8e-430b-b021-fbff5225499a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:45.276237 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7b157772-cf8e-430b-b021-fbff5225499a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:45.282682 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b157772-cf8e-430b-b021-fbff5225499a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.283214 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b157772-cf8e-430b-b021-fbff5225499a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.284042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b157772-cf8e-430b-b021-fbff5225499a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.284581 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b157772-cf8e-430b-b021-fbff5225499a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.307859 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7b157772-cf8e-430b-b021-fbff5225499a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0/ips" status: 200 len: 150 microversion: 2.1 time: 0.139742 Aug 01 14:15:45.308578 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 399/803] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:15:45 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0/ips => generated 150 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:45.319670 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "923506b4-7235-4385-ae97-bc61fac6ad40"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:45.322129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:45.329629 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.329629 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.330074 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.330507 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.419956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Invalid volume: volume 923506b4-7235-4385-ae97-bc61fac6ad40 is already attached to instances: 78cc4e77-f019-4285-ac19-c01b7c96a515 Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: POST /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0/os-volume_attachments HTTP/1.1 Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 74 Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:15:45.421716 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {"volumeAttachment": {"volumeId": "923506b4-7235-4385-ae97-bc61fac6ad40"}} Aug 01 14:15:45.423056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Invalid volume: volume 923506b4-7235-4385-ae97-bc61fac6ad40 is already attached to instances: 78cc4e77-f019-4285-ac19-c01b7c96a515 Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'server_id': '98847e8e-92b8-46b9-bb66-3b374c9a81b0', 'body': {'volumeAttachment': {'volumeId': '923506b4-7235-4385-ae97-bc61fac6ad40'}}} Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 923506b4-7235-4385-ae97-bc61fac6ad40 is already attached to instances: 78cc4e77-f019-4285-ac19-c01b7c96a515 Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:45.423846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 923506b4-7235-4385-ae97-bc61fac6ad40 is already attached to instances: 78cc4e77-f019-4285-ac19-c01b7c96a515 Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:45.425122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:45.426358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:45.426358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:15:45.426358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:15:45.426358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 923506b4-7235-4385-ae97-bc61fac6ad40 is already attached to instances: 78cc4e77-f019-4285-ac19-c01b7c96a515 Aug 01 14:15:45.426358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:45.426358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 400 to user: Invalid volume: volume 923506b4-7235-4385-ae97-bc61fac6ad40 is already attached to instances: 78cc4e77-f019-4285-ac19-c01b7c96a515 {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:15:45.426358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f44d2aee-79d9-4e36-ad97-eb830ae0a3d3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107291 Aug 01 14:15:45.426358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 400/804] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:15:45 2022] POST /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 01 14:15:45.432529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-56f76e30-c534-459b-90cd-79b3998de57d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:45.433033 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-56f76e30-c534-459b-90cd-79b3998de57d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:45.440434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56f76e30-c534-459b-90cd-79b3998de57d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.440912 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56f76e30-c534-459b-90cd-79b3998de57d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.441694 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56f76e30-c534-459b-90cd-79b3998de57d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.442129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56f76e30-c534-459b-90cd-79b3998de57d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.469239 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-56f76e30-c534-459b-90cd-79b3998de57d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:15:45.553060 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-56f76e30-c534-459b-90cd-79b3998de57d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 204 len: 0 microversion: 2.1 time: 0.123711 Aug 01 14:15:45.554114 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 401/805] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:15:45 2022] DELETE /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:15:45.568536 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ea1a9ff5-5242-4dd0-860e-0c41dca9f498 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:45.569267 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ea1a9ff5-5242-4dd0-860e-0c41dca9f498 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:45.577909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea1a9ff5-5242-4dd0-860e-0c41dca9f498 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.578969 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea1a9ff5-5242-4dd0-860e-0c41dca9f498 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.579803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea1a9ff5-5242-4dd0-860e-0c41dca9f498 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.580235 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea1a9ff5-5242-4dd0-860e-0c41dca9f498 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.714268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ea1a9ff5-5242-4dd0-860e-0c41dca9f498 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:45.721993 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ea1a9ff5-5242-4dd0-860e-0c41dca9f498 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1682 microversion: 2.1 time: 0.163020 Aug 01 14:15:45.722656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 402/806] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:45 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:45.952781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:15:45.953235 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:15:45.953707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:15:45.954115 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:15:45.954526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:15:45.963244 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.963687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.964535 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:45.964976 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:45.981676 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Getting quotas for project d11b6361110344b0a67b6b73ccc0c2f4. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:15:45.986101 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Getting quotas for user 86cef19aed2a45fb87c30dbd2d422dae and project d11b6361110344b0a67b6b73ccc0c2f4. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:15:46.041130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:15:46.043313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f4341d5-f97b-4bc3-97b8-bc752a7b1086',volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:15:46.170400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1081b633-affc-4d82-a51a-3cbfe555a935 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.051098 Aug 01 14:15:46.171028 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 405/807] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:15:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 1053 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:15:46.182144 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-60617375-3ade-44ba-b38d-c71db6458dc2 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:46.182785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-60617375-3ade-44ba-b38d-c71db6458dc2 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:46.235536 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-60617375-3ade-44ba-b38d-c71db6458dc2 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:46.242200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-60617375-3ade-44ba-b38d-c71db6458dc2 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1088 microversion: 2.1 time: 0.063800 Aug 01 14:15:46.242998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 403/808] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:46 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:46.745110 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-326dc6e8-8929-436f-965d-230d7232c333 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:46.745779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-326dc6e8-8929-436f-965d-230d7232c333 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:46.752060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-326dc6e8-8929-436f-965d-230d7232c333 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:46.752519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-326dc6e8-8929-436f-965d-230d7232c333 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:46.753276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-326dc6e8-8929-436f-965d-230d7232c333 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:46.753709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-326dc6e8-8929-436f-965d-230d7232c333 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:46.883950 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-326dc6e8-8929-436f-965d-230d7232c333 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:46.891897 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-326dc6e8-8929-436f-965d-230d7232c333 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1682 microversion: 2.1 time: 0.151469 Aug 01 14:15:46.892528 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 406/809] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:46 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:47.263533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8b190cd2-5d2e-4315-a621-c8e2f229d77e tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:47.264141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8b190cd2-5d2e-4315-a621-c8e2f229d77e tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:47.315900 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8b190cd2-5d2e-4315-a621-c8e2f229d77e tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:47.322558 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8b190cd2-5d2e-4315-a621-c8e2f229d77e tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1088 microversion: 2.1 time: 0.062836 Aug 01 14:15:47.323120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 404/810] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:47 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1088 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:47.912961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fe92a9d6-05b7-41a1-b45e-fdf0c938ec08 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:47.913742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fe92a9d6-05b7-41a1-b45e-fdf0c938ec08 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:47.919913 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fe92a9d6-05b7-41a1-b45e-fdf0c938ec08 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.920364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fe92a9d6-05b7-41a1-b45e-fdf0c938ec08 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:47.923181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fe92a9d6-05b7-41a1-b45e-fdf0c938ec08 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:47.923633 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fe92a9d6-05b7-41a1-b45e-fdf0c938ec08 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:48.067653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fe92a9d6-05b7-41a1-b45e-fdf0c938ec08 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:48.078368 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fe92a9d6-05b7-41a1-b45e-fdf0c938ec08 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1682 microversion: 2.1 time: 0.166997 Aug 01 14:15:48.078988 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 407/811] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:47 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:48.346093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4dde0957-0382-4d49-bffc-1daa0c0f5145 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:48.346763 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4dde0957-0382-4d49-bffc-1daa0c0f5145 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:48.353909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4dde0957-0382-4d49-bffc-1daa0c0f5145 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:48.354684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4dde0957-0382-4d49-bffc-1daa0c0f5145 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:48.355585 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4dde0957-0382-4d49-bffc-1daa0c0f5145 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:48.356022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4dde0957-0382-4d49-bffc-1daa0c0f5145 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:48.475644 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4dde0957-0382-4d49-bffc-1daa0c0f5145 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:48.485509 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4dde0957-0382-4d49-bffc-1daa0c0f5145 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1186 microversion: 2.1 time: 0.144886 Aug 01 14:15:48.486111 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 405/812] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:48 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1186 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:49.104041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-974cacb5-5ac5-47d6-9881-935ffbf1f9e9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:49.105251 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-974cacb5-5ac5-47d6-9881-935ffbf1f9e9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:49.113278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-974cacb5-5ac5-47d6-9881-935ffbf1f9e9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:49.113860 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-974cacb5-5ac5-47d6-9881-935ffbf1f9e9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:49.114888 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-974cacb5-5ac5-47d6-9881-935ffbf1f9e9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:49.115254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-974cacb5-5ac5-47d6-9881-935ffbf1f9e9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:49.185281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-974cacb5-5ac5-47d6-9881-935ffbf1f9e9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:49.208670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-974cacb5-5ac5-47d6-9881-935ffbf1f9e9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 200 len: 1614 microversion: 2.1 time: 0.108661 Aug 01 14:15:49.223422 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 408/813] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:49 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 1614 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:49.290067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-2bbfe328-6ed1-4366-ba00-ada5adf82996 req-e210d2ff-a962-4b95-b5a3-b761b8904886 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98847e8e-92b8-46b9-bb66-3b374c9a81b0", "name": "network-vif-deleted", "tag": "b94eab45-df8a-46b1-8ac7-6a080ffcb4e7"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:49.304386 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-2bbfe328-6ed1-4366-ba00-ada5adf82996 req-e210d2ff-a962-4b95-b5a3-b761b8904886 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:49.306209 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-2bbfe328-6ed1-4366-ba00-ada5adf82996 req-e210d2ff-a962-4b95-b5a3-b761b8904886 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:49.340525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-2bbfe328-6ed1-4366-ba00-ada5adf82996 req-e210d2ff-a962-4b95-b5a3-b761b8904886 service nova] Creating event network-vif-deleted:b94eab45-df8a-46b1-8ac7-6a080ffcb4e7 for instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 on hv-cinder-84713 Aug 01 14:15:49.355649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-2bbfe328-6ed1-4366-ba00-ada5adf82996 req-e210d2ff-a962-4b95-b5a3-b761b8904886 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158471 Aug 01 14:15:49.357286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 406/814] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:15:49.507718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-84ecf972-20d9-4d0f-81ce-10aec6e7ac1b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:49.508647 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-84ecf972-20d9-4d0f-81ce-10aec6e7ac1b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:49.515144 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-84ecf972-20d9-4d0f-81ce-10aec6e7ac1b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:49.515998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-84ecf972-20d9-4d0f-81ce-10aec6e7ac1b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:49.516999 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-84ecf972-20d9-4d0f-81ce-10aec6e7ac1b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:49.517444 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-84ecf972-20d9-4d0f-81ce-10aec6e7ac1b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:49.583069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-84ecf972-20d9-4d0f-81ce-10aec6e7ac1b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:49.590978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-84ecf972-20d9-4d0f-81ce-10aec6e7ac1b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1204 microversion: 2.1 time: 0.087622 Aug 01 14:15:49.591919 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 409/815] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:49 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1204 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:50.231769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:50.233075 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:50.240795 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:50.241395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:50.242412 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:50.242947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:50.257328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 HTTP/1.1 Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:15:50.259323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:15:50.260981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '98847e8e-92b8-46b9-bb66-3b374c9a81b0'} Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:15:50.261723 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:15:50.262875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:15:50.265239 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:15:50.266363 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8d340a67-3886-482a-a648-2d1c928dbf1d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 404 len: 111 microversion: 2.1 time: 0.039797 Aug 01 14:15:50.267168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 407/816] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:50 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:15:50.275708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-63d6a1ce-1420-499b-a363-ff3b5494f27b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '.version_select at 0x7f4462d2fca0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:50.311384 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-63d6a1ce-1420-499b-a363-ff3b5494f27b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875564812" status: 202 len: 0 microversion: 2.1 time: 0.039277 Aug 01 14:15:50.312861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 410/817] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 14:15:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875564812 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:15:50.612783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1f7bd7bf-209a-49f6-ac2e-af9881ad8060 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:50.613398 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1f7bd7bf-209a-49f6-ac2e-af9881ad8060 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:50.620130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f7bd7bf-209a-49f6-ac2e-af9881ad8060 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:50.620616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f7bd7bf-209a-49f6-ac2e-af9881ad8060 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:50.621397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f7bd7bf-209a-49f6-ac2e-af9881ad8060 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:50.621831 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f7bd7bf-209a-49f6-ac2e-af9881ad8060 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:50.979619 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1f7bd7bf-209a-49f6-ac2e-af9881ad8060 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:50.987681 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1f7bd7bf-209a-49f6-ac2e-af9881ad8060 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.378856 Aug 01 14:15:50.988272 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 408/818] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:50 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:51.382472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-9a1f1f76-66b9-44e0-bbd1-2a63b1af283b req-10c0e03d-d45c-46b0-a109-9549ca47d25b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be944f58-3d1b-43af-bd53-5d0f0c17f6a7", "tag": "6557d142-b394-4c3c-b200-64bd14908f59"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:51.393761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-9a1f1f76-66b9-44e0-bbd1-2a63b1af283b req-10c0e03d-d45c-46b0-a109-9549ca47d25b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:51.394217 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-9a1f1f76-66b9-44e0-bbd1-2a63b1af283b req-10c0e03d-d45c-46b0-a109-9549ca47d25b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:51.404744 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-9a1f1f76-66b9-44e0-bbd1-2a63b1af283b req-10c0e03d-d45c-46b0-a109-9549ca47d25b service nova] Creating event network-changed:6557d142-b394-4c3c-b200-64bd14908f59 for instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 on hv-cinder-84713 Aug 01 14:15:51.409903 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-9a1f1f76-66b9-44e0-bbd1-2a63b1af283b req-10c0e03d-d45c-46b0-a109-9549ca47d25b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031680 Aug 01 14:15:51.410749 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 411/819] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:51.452269 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be7b95b2-f8c7-4d73-9b2a-844547af44e8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:51.452865 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be7b95b2-f8c7-4d73-9b2a-844547af44e8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:51.458878 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be7b95b2-f8c7-4d73-9b2a-844547af44e8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:51.459326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be7b95b2-f8c7-4d73-9b2a-844547af44e8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:51.460090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be7b95b2-f8c7-4d73-9b2a-844547af44e8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:51.460547 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be7b95b2-f8c7-4d73-9b2a-844547af44e8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:51.539480 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-be7b95b2-f8c7-4d73-9b2a-844547af44e8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lazy-loading 'services' on Instance uuid 78cc4e77-f019-4285-ac19-c01b7c96a515 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:15:51.614018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be7b95b2-f8c7-4d73-9b2a-844547af44e8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments/923506b4-7235-4385-ae97-bc61fac6ad40" status: 202 len: 0 microversion: 2.1 time: 0.165711 Aug 01 14:15:51.614646 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 409/820] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:15:51 2022] DELETE /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments/923506b4-7235-4385-ae97-bc61fac6ad40 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:15:51.623479 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-683a5efc-9fa3-4f91-9f43-497bda40dae5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:51.625707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-683a5efc-9fa3-4f91-9f43-497bda40dae5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:51.632105 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-683a5efc-9fa3-4f91-9f43-497bda40dae5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:51.632595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-683a5efc-9fa3-4f91-9f43-497bda40dae5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:51.633375 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-683a5efc-9fa3-4f91-9f43-497bda40dae5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:51.633817 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-683a5efc-9fa3-4f91-9f43-497bda40dae5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:51.665615 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-683a5efc-9fa3-4f91-9f43-497bda40dae5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046326 Aug 01 14:15:51.666203 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 412/821] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:15:51 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:52.010406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-509c817e-1ec1-4051-8163-5a54d2bfe5f6 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:52.011105 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-509c817e-1ec1-4051-8163-5a54d2bfe5f6 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:52.017914 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-509c817e-1ec1-4051-8163-5a54d2bfe5f6 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:52.018356 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-509c817e-1ec1-4051-8163-5a54d2bfe5f6 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:52.019117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-509c817e-1ec1-4051-8163-5a54d2bfe5f6 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:52.019549 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-509c817e-1ec1-4051-8163-5a54d2bfe5f6 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:52.159190 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-509c817e-1ec1-4051-8163-5a54d2bfe5f6 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:52.166891 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-509c817e-1ec1-4051-8163-5a54d2bfe5f6 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.161375 Aug 01 14:15:52.167459 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 410/822] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:52 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:52.684932 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-264e7d59-b9ca-4a6a-8dcf-10c5ef7dad9a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:52.687441 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-264e7d59-b9ca-4a6a-8dcf-10c5ef7dad9a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:52.694713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-264e7d59-b9ca-4a6a-8dcf-10c5ef7dad9a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:52.695233 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-264e7d59-b9ca-4a6a-8dcf-10c5ef7dad9a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:52.696076 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-264e7d59-b9ca-4a6a-8dcf-10c5ef7dad9a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:52.696596 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-264e7d59-b9ca-4a6a-8dcf-10c5ef7dad9a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:52.728041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-264e7d59-b9ca-4a6a-8dcf-10c5ef7dad9a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053179 Aug 01 14:15:52.728626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 413/823] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:15:52 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:15:53.188116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-44e2e115-76df-4022-941c-24dcf68805ef tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:53.188759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-44e2e115-76df-4022-941c-24dcf68805ef tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:53.195287 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-44e2e115-76df-4022-941c-24dcf68805ef tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:53.195867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-44e2e115-76df-4022-941c-24dcf68805ef tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:53.196892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-44e2e115-76df-4022-941c-24dcf68805ef tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:53.197344 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-44e2e115-76df-4022-941c-24dcf68805ef tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:53.326953 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-44e2e115-76df-4022-941c-24dcf68805ef tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:53.334281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-44e2e115-76df-4022-941c-24dcf68805ef tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.150191 Aug 01 14:15:53.334846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 411/824] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:53 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:53.740003 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6b2d2409-35a6-46b8-9aaa-3035c40ee1a3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:53.742064 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6b2d2409-35a6-46b8-9aaa-3035c40ee1a3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:53.748361 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6b2d2409-35a6-46b8-9aaa-3035c40ee1a3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:53.748867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6b2d2409-35a6-46b8-9aaa-3035c40ee1a3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:53.750221 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6b2d2409-35a6-46b8-9aaa-3035c40ee1a3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:53.750652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6b2d2409-35a6-46b8-9aaa-3035c40ee1a3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:53.779071 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6b2d2409-35a6-46b8-9aaa-3035c40ee1a3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043080 Aug 01 14:15:53.779627 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 414/825] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:15:53 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:54.355066 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ab79272c-155f-473f-a9fb-45a92d64c981 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:54.355778 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ab79272c-155f-473f-a9fb-45a92d64c981 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:54.362354 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab79272c-155f-473f-a9fb-45a92d64c981 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:54.362799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab79272c-155f-473f-a9fb-45a92d64c981 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:54.363557 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab79272c-155f-473f-a9fb-45a92d64c981 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:54.363989 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab79272c-155f-473f-a9fb-45a92d64c981 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:54.497652 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ab79272c-155f-473f-a9fb-45a92d64c981 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:54.505641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ab79272c-155f-473f-a9fb-45a92d64c981 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.154452 Aug 01 14:15:54.506303 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 412/826] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:54 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:54.791277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-225dee46-619d-416b-8277-f8a432e82f27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:54.793515 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-225dee46-619d-416b-8277-f8a432e82f27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:54.800035 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-225dee46-619d-416b-8277-f8a432e82f27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:54.800507 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-225dee46-619d-416b-8277-f8a432e82f27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:54.801336 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-225dee46-619d-416b-8277-f8a432e82f27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:54.801778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-225dee46-619d-416b-8277-f8a432e82f27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:54.832246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-225dee46-619d-416b-8277-f8a432e82f27 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044933 Aug 01 14:15:54.832841 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 415/827] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:15:54 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:15:54.895106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8c63b778-bdf8-4e42-a55a-6c8f7c997cf6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:54.895598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8c63b778-bdf8-4e42-a55a-6c8f7c997cf6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:54.901466 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c63b778-bdf8-4e42-a55a-6c8f7c997cf6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:54.901909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c63b778-bdf8-4e42-a55a-6c8f7c997cf6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:54.902653 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c63b778-bdf8-4e42-a55a-6c8f7c997cf6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:54.903077 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c63b778-bdf8-4e42-a55a-6c8f7c997cf6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:54.927090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8c63b778-bdf8-4e42-a55a-6c8f7c997cf6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:15:54.999844 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8c63b778-bdf8-4e42-a55a-6c8f7c997cf6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 204 len: 0 microversion: 2.1 time: 0.107707 Aug 01 14:15:55.000492 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 413/828] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:15:54 2022] DELETE /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:15:55.008985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c09c97c1-2053-4268-b293-881289bdfc04 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:55.009604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c09c97c1-2053-4268-b293-881289bdfc04 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:55.016331 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c09c97c1-2053-4268-b293-881289bdfc04 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.016814 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c09c97c1-2053-4268-b293-881289bdfc04 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.017599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c09c97c1-2053-4268-b293-881289bdfc04 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.018043 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c09c97c1-2053-4268-b293-881289bdfc04 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.148973 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c09c97c1-2053-4268-b293-881289bdfc04 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:55.156296 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c09c97c1-2053-4268-b293-881289bdfc04 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1680 microversion: 2.1 time: 0.151185 Aug 01 14:15:55.156989 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 416/829] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:55 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1680 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:55.526498 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7be2a25a-d926-4585-9d98-32a5cd7b5381 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:55.527111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7be2a25a-d926-4585-9d98-32a5cd7b5381 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:55.529165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-313afc71-a4ce-42a4-b03f-97c16b3ffa10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:55.529748 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-313afc71-a4ce-42a4-b03f-97c16b3ffa10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:55.533232 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7be2a25a-d926-4585-9d98-32a5cd7b5381 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.533771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7be2a25a-d926-4585-9d98-32a5cd7b5381 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.534607 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7be2a25a-d926-4585-9d98-32a5cd7b5381 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.535125 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7be2a25a-d926-4585-9d98-32a5cd7b5381 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.535624 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313afc71-a4ce-42a4-b03f-97c16b3ffa10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.536066 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313afc71-a4ce-42a4-b03f-97c16b3ffa10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.536851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313afc71-a4ce-42a4-b03f-97c16b3ffa10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.537284 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-313afc71-a4ce-42a4-b03f-97c16b3ffa10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.566287 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-313afc71-a4ce-42a4-b03f-97c16b3ffa10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments/ca6e5fd3-e844-4daf-8a73-3e5bed2db9b5" status: 200 len: 194 microversion: 2.20 time: 0.140891 Aug 01 14:15:55.566876 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 414/830] 10.222.0.48 () {60 vars in 1454 bytes} [Mon Aug 1 14:15:55 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments/ca6e5fd3-e844-4daf-8a73-3e5bed2db9b5 => generated 194 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:15:55.634291 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-30630fa8-74b7-4e92-9553-e378bbf492c5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:55.634780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-30630fa8-74b7-4e92-9553-e378bbf492c5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:55.641499 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30630fa8-74b7-4e92-9553-e378bbf492c5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.641984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30630fa8-74b7-4e92-9553-e378bbf492c5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.643016 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30630fa8-74b7-4e92-9553-e378bbf492c5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.643453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30630fa8-74b7-4e92-9553-e378bbf492c5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.648184 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:55.668234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7be2a25a-d926-4585-9d98-32a5cd7b5381 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:55.676583 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7be2a25a-d926-4585-9d98-32a5cd7b5381 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.153739 Aug 01 14:15:55.677161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 417/831] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:55 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:55.727661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-30630fa8-74b7-4e92-9553-e378bbf492c5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lazy-loading 'services' on Instance uuid 51fd7ad6-9939-4561-b0fa-f45f8602eccf {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:15:55.796568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-30630fa8-74b7-4e92-9553-e378bbf492c5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "DELETE /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments/ca6e5fd3-e844-4daf-8a73-3e5bed2db9b5" status: 202 len: 0 microversion: 2.20 time: 0.165398 Aug 01 14:15:55.797142 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 415/832] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Aug 1 14:15:55 2022] DELETE /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments/ca6e5fd3-e844-4daf-8a73-3e5bed2db9b5 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:15:55.805631 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-11631f33-da26-4519-964a-394b0e4c919f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:55.807885 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-11631f33-da26-4519-964a-394b0e4c919f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:55.815737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11631f33-da26-4519-964a-394b0e4c919f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.816273 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11631f33-da26-4519-964a-394b0e4c919f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.817090 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11631f33-da26-4519-964a-394b0e4c919f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:55.817748 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-11631f33-da26-4519-964a-394b0e4c919f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:55.848738 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-11631f33-da26-4519-964a-394b0e4c919f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047012 Aug 01 14:15:55.849308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 418/833] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 14:15:55 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:15:56.178655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-64867cca-bf18-493b-8ffe-d1cefa806214 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:56.179361 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-64867cca-bf18-493b-8ffe-d1cefa806214 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:56.185671 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64867cca-bf18-493b-8ffe-d1cefa806214 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:56.186109 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64867cca-bf18-493b-8ffe-d1cefa806214 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:56.186998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64867cca-bf18-493b-8ffe-d1cefa806214 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:56.187435 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64867cca-bf18-493b-8ffe-d1cefa806214 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:56.316742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-64867cca-bf18-493b-8ffe-d1cefa806214 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:56.324112 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-64867cca-bf18-493b-8ffe-d1cefa806214 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1680 microversion: 2.1 time: 0.149744 Aug 01 14:15:56.324956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 416/834] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:56 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:56.697890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dfae4025-6991-4d55-a054-ee309b071119 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:56.698501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dfae4025-6991-4d55-a054-ee309b071119 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:56.700702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:56.701364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=6 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:56.708121 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dfae4025-6991-4d55-a054-ee309b071119 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:56.708621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dfae4025-6991-4d55-a054-ee309b071119 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:56.709383 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dfae4025-6991-4d55-a054-ee309b071119 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:56.709817 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dfae4025-6991-4d55-a054-ee309b071119 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:56.856676 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dfae4025-6991-4d55-a054-ee309b071119 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:56.861391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dd97a11b-853a-45f8-8d41-e55b843f75ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:56.863697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dd97a11b-853a-45f8-8d41-e55b843f75ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:56.864471 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dfae4025-6991-4d55-a054-ee309b071119 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.170345 Aug 01 14:15:56.865275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 419/835] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:56 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:56.883946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd97a11b-853a-45f8-8d41-e55b843f75ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:56.884392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd97a11b-853a-45f8-8d41-e55b843f75ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:56.885954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd97a11b-853a-45f8-8d41-e55b843f75ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:56.886397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd97a11b-853a-45f8-8d41-e55b843f75ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:56.917286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dd97a11b-853a-45f8-8d41-e55b843f75ff tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059889 Aug 01 14:15:56.918467 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 417/836] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 14:15:56 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:15:57.345791 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3dba0eb4-a5f4-4785-83da-ce59abea4b26 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:57.347197 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3dba0eb4-a5f4-4785-83da-ce59abea4b26 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:57.353190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3dba0eb4-a5f4-4785-83da-ce59abea4b26 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.353639 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3dba0eb4-a5f4-4785-83da-ce59abea4b26 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.354405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3dba0eb4-a5f4-4785-83da-ce59abea4b26 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.354847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3dba0eb4-a5f4-4785-83da-ce59abea4b26 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.419463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3dba0eb4-a5f4-4785-83da-ce59abea4b26 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:57.427600 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3dba0eb4-a5f4-4785-83da-ce59abea4b26 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1612 microversion: 2.1 time: 0.085671 Aug 01 14:15:57.428186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 420/837] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:57 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:57.581143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-9079f6a0-ebbf-43b3-a8be-1b7da14098b9 req-bcd750fc-27fc-4c38-80a0-95e24425c57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78cc4e77-f019-4285-ac19-c01b7c96a515", "name": "network-vif-deleted", "tag": "07e3e2e9-2e5a-45dc-8c38-d0fda52efe94"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:15:57.587410 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:57.592239 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9079f6a0-ebbf-43b3-a8be-1b7da14098b9 req-bcd750fc-27fc-4c38-80a0-95e24425c57d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.593231 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9079f6a0-ebbf-43b3-a8be-1b7da14098b9 req-bcd750fc-27fc-4c38-80a0-95e24425c57d service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.605151 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-9079f6a0-ebbf-43b3-a8be-1b7da14098b9 req-bcd750fc-27fc-4c38-80a0-95e24425c57d service nova] Creating event network-vif-deleted:07e3e2e9-2e5a-45dc-8c38-d0fda52efe94 for instance 78cc4e77-f019-4285-ac19-c01b7c96a515 on hv-cinder-84713 Aug 01 14:15:57.611538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-9079f6a0-ebbf-43b3-a8be-1b7da14098b9 req-bcd750fc-27fc-4c38-80a0-95e24425c57d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034526 Aug 01 14:15:57.613049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 418/838] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:15:57.887556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4428e0f0-3876-44f5-925e-ddea709dbd35 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:57.888468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4428e0f0-3876-44f5-925e-ddea709dbd35 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:57.896753 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4428e0f0-3876-44f5-925e-ddea709dbd35 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.897304 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4428e0f0-3876-44f5-925e-ddea709dbd35 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.899055 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4428e0f0-3876-44f5-925e-ddea709dbd35 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.900041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4428e0f0-3876-44f5-925e-ddea709dbd35 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.930937 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-daf70bf3-f3b9-4cc2-8439-34280eb9e8cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:57.933254 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-daf70bf3-f3b9-4cc2-8439-34280eb9e8cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:57.941039 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-daf70bf3-f3b9-4cc2-8439-34280eb9e8cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.941701 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-daf70bf3-f3b9-4cc2-8439-34280eb9e8cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.942485 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-daf70bf3-f3b9-4cc2-8439-34280eb9e8cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:57.942921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-daf70bf3-f3b9-4cc2-8439-34280eb9e8cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:57.975602 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-daf70bf3-f3b9-4cc2-8439-34280eb9e8cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049647 Aug 01 14:15:57.976613 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 419/839] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 14:15:57 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:58.042996 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4428e0f0-3876-44f5-925e-ddea709dbd35 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:58.043541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-97f48bbb-60e7-41d0-a14d-990cab2cc663 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:58.044166 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-97f48bbb-60e7-41d0-a14d-990cab2cc663 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:58.052113 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4428e0f0-3876-44f5-925e-ddea709dbd35 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.169250 Aug 01 14:15:58.052641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97f48bbb-60e7-41d0-a14d-990cab2cc663 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.052967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 421/840] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:57 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:58.058599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97f48bbb-60e7-41d0-a14d-990cab2cc663 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:58.059856 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97f48bbb-60e7-41d0-a14d-990cab2cc663 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.060456 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97f48bbb-60e7-41d0-a14d-990cab2cc663 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:58.088404 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-97f48bbb-60e7-41d0-a14d-990cab2cc663 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:15:58.163280 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-97f48bbb-60e7-41d0-a14d-990cab2cc663 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "DELETE /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 204 len: 0 microversion: 2.20 time: 0.124044 Aug 01 14:15:58.163778 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 420/841] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 14:15:58 2022] DELETE /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:15:58.172084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:58.172730 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:58.178541 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.178987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:58.179744 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.180170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:58.308779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:58.317571 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:58.319025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:58.320235 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7adff29a-c6af-4fc0-a0e6-f607b5b06381 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.152227 Aug 01 14:15:58.320854 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 422/842] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:58 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:15:58.450605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:58.451316 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:58.458191 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.458645 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:58.459428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.459868 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:58.491945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:58.492396 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:58.492879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lazy-loading 'fault' on Instance uuid 78cc4e77-f019-4285-ac19-c01b7c96a515 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:15:58.536277 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:58.543903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bc7625b7-fe23-40ff-92fd-a264669ded54 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1330 microversion: 2.1 time: 0.097811 Aug 01 14:15:58.544505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 421/843] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:58 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:15:59.073909 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d5816aaf-f38d-4ae7-b55c-b5bcab1b8b55 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:59.074731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d5816aaf-f38d-4ae7-b55c-b5bcab1b8b55 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:59.081547 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5816aaf-f38d-4ae7-b55c-b5bcab1b8b55 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:59.082004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5816aaf-f38d-4ae7-b55c-b5bcab1b8b55 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:59.082771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5816aaf-f38d-4ae7-b55c-b5bcab1b8b55 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:59.083216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d5816aaf-f38d-4ae7-b55c-b5bcab1b8b55 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:59.218945 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d5816aaf-f38d-4ae7-b55c-b5bcab1b8b55 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:59.222422 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:59.227138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d5816aaf-f38d-4ae7-b55c-b5bcab1b8b55 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.157377 Aug 01 14:15:59.227741 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 423/844] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:59 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:15:59.344532 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:59.345116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:59.351493 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:59.351941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:59.352731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:59.353174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:59.480947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:59.488765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:59.490255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:59.491392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6d2341b6-81dc-4fa5-bd51-b2159f2ffd98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.151356 Aug 01 14:15:59.491947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 422/845] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:15:59 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:15:59.564896 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:15:59.565568 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:15:59.571740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:59.572219 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:59.573017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:59.573460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:59.605208 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:15:59.605584 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:15:59.606030 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lazy-loading 'fault' on Instance uuid 78cc4e77-f019-4285-ac19-c01b7c96a515 {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:15:59.646269 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:15:59.653587 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fff9f397-95c5-45d4-ae80-d2ee703296cf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1330 microversion: 2.1 time: 0.092560 Aug 01 14:15:59.654160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 424/846] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:15:59 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:00.247470 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f50a59ee-5b41-4fff-a1a6-42f531dae65c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:00.248141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f50a59ee-5b41-4fff-a1a6-42f531dae65c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:00.254857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f50a59ee-5b41-4fff-a1a6-42f531dae65c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.255247 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f50a59ee-5b41-4fff-a1a6-42f531dae65c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.256004 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f50a59ee-5b41-4fff-a1a6-42f531dae65c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.256440 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f50a59ee-5b41-4fff-a1a6-42f531dae65c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.384443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f50a59ee-5b41-4fff-a1a6-42f531dae65c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:00.392399 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f50a59ee-5b41-4fff-a1a6-42f531dae65c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.148782 Aug 01 14:16:00.392997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 423/847] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:00 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:00.514103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:00.514720 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:00.521221 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.521673 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.522439 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.522877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.649505 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:00.657832 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:00.659348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:00.660501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-34cfeb9b-0884-4abf-9c49-d854387678cd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.150322 Aug 01 14:16:00.661060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 425/848] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:00 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:00.675026 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:00.675641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:00.681802 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.682252 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.683013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.683452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.720736 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:00.721186 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:00.726569 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lazy-loading 'fault' on Instance uuid 78cc4e77-f019-4285-ac19-c01b7c96a515 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:16:00.772234 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:00.779727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2b999827-284f-4293-8fed-7bbf882a599b tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 200 len: 1330 microversion: 2.1 time: 0.109152 Aug 01 14:16:00.780324 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 424/849] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:00 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 1330 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:01.413024 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-14c918d2-773c-4f1c-a30f-20bffdf39dba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:01.413697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-14c918d2-773c-4f1c-a30f-20bffdf39dba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:01.419707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14c918d2-773c-4f1c-a30f-20bffdf39dba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:01.420155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14c918d2-773c-4f1c-a30f-20bffdf39dba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:01.421569 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14c918d2-773c-4f1c-a30f-20bffdf39dba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:01.422005 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-14c918d2-773c-4f1c-a30f-20bffdf39dba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:01.557870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-14c918d2-773c-4f1c-a30f-20bffdf39dba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:01.565240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-14c918d2-773c-4f1c-a30f-20bffdf39dba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.156115 Aug 01 14:16:01.565802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 426/850] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:01 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:01.684172 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:01.684714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:01.691277 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:01.691720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:01.692501 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:01.692936 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:01.805758 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:01.806939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:01.815703 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:01.816503 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:01.817857 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:01.818464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:01.849003 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 HTTP/1.1 Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:16:01.850711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:16:01.852179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '78cc4e77-f019-4285-ac19-c01b7c96a515'} Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:01.853008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:16:01.854358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:01.855697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:01.855697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-82d184ed-a3fb-493b-9cc1-920fe19a80b2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 404 len: 111 microversion: 2.1 time: 0.055483 Aug 01 14:16:01.857684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 427/851] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:01 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:16:01.862868 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5ae0904b-f976-46c0-a994-6e45d893b346 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '.version_select at 0x7f4462ddc9d0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:01.890392 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5ae0904b-f976-46c0-a994-6e45d893b346 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-510544960" status: 202 len: 0 microversion: 2.1 time: 0.031525 Aug 01 14:16:01.890987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 428/852] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 14:16:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-510544960 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:16:01.904835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:01.913739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:01.915272 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:01.916821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4fd156fe-be08-4124-8d3b-7e1955c80007 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1725 microversion: 2.20 time: 0.236645 Aug 01 14:16:01.931624 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 425/853] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:01 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:02.588981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-929074c4-2bd2-4cf8-892f-6f74ea389715 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:02.589986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-929074c4-2bd2-4cf8-892f-6f74ea389715 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:02.599934 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-929074c4-2bd2-4cf8-892f-6f74ea389715 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:02.600551 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-929074c4-2bd2-4cf8-892f-6f74ea389715 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:02.601475 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-929074c4-2bd2-4cf8-892f-6f74ea389715 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:02.602102 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-929074c4-2bd2-4cf8-892f-6f74ea389715 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:02.611390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a796211a-0591-4b3a-8cfa-c145a19289f4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: .version_select at 0x7f4462d3c310>, body: {"keypair": {"name": "tempest-keypair-570911533", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBxxpWH9VDW82NPYhAyBbiWx10objNxn7TVY3JcbdO2aYn4XOiHEDt8X4GJZC7XYadTqGfIXKYa8g9pJ+aZYS/AQlKXDO8wQKxaRY3UMn7fhEtfb+Qd+vw4EjBzHcC2RSw=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:02.627690 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a796211a-0591-4b3a-8cfa-c145a19289f4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for project a3203f080a05422e83090a1f0a31d1a9. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:16:02.631694 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a796211a-0591-4b3a-8cfa-c145a19289f4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for user ca3cd1c2aec94b43aff0034b812a069d and project a3203f080a05422e83090a1f0a31d1a9. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:16:02.665959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a796211a-0591-4b3a-8cfa-c145a19289f4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058254 Aug 01 14:16:02.667226 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 426/854] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:16:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:02.812769 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-929074c4-2bd2-4cf8-892f-6f74ea389715 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:02.825328 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-929074c4-2bd2-4cf8-892f-6f74ea389715 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.241022 Aug 01 14:16:02.827603 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 429/855] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:02 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:02.941131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:02.942257 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:02.949664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:02.950282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:02.951194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:02.952493 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:03.070735 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:03.087547 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:03.091570 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:03.094661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-02e44221-3e22-4c93-8f36-453d0ae711be tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 200 len: 1658 microversion: 2.20 time: 0.158315 Aug 01 14:16:03.098415 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 427/856] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:02 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 1658 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:03.105448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-1d2869ab-de4f-4c1f-b77d-9d0d15692bef req-719754df-08dd-4efd-9a5e-608fe561c1e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51fd7ad6-9939-4561-b0fa-f45f8602eccf", "name": "network-vif-deleted", "tag": "74f5404a-20d0-4b4a-8fec-5f4dbc58380a"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:03.134695 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1d2869ab-de4f-4c1f-b77d-9d0d15692bef req-719754df-08dd-4efd-9a5e-608fe561c1e3 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:03.135520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1d2869ab-de4f-4c1f-b77d-9d0d15692bef req-719754df-08dd-4efd-9a5e-608fe561c1e3 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:03.155851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-1d2869ab-de4f-4c1f-b77d-9d0d15692bef req-719754df-08dd-4efd-9a5e-608fe561c1e3 service nova] Creating event network-vif-deleted:74f5404a-20d0-4b4a-8fec-5f4dbc58380a for instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf on hv-cinder-84713 Aug 01 14:16:03.161520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-1d2869ab-de4f-4c1f-b77d-9d0d15692bef req-719754df-08dd-4efd-9a5e-608fe561c1e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061376 Aug 01 14:16:03.162794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 428/857] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:03.224589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6f96f6d2-c872-4643-b7de-5f8ac9cb8663 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1435224631"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:03.225164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6f96f6d2-c872-4643-b7de-5f8ac9cb8663 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:03.243270 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6f96f6d2-c872-4643-b7de-5f8ac9cb8663 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:03.244296 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6f96f6d2-c872-4643-b7de-5f8ac9cb8663 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:03.246937 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6f96f6d2-c872-4643-b7de-5f8ac9cb8663 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:03.247337 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6f96f6d2-c872-4643-b7de-5f8ac9cb8663 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:03.547232 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.network.security_group_api [None req-6f96f6d2-c872-4643-b7de-5f8ac9cb8663 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Removing security group a380e009-93fb-49c3-aa11-b79b4a7edc7f from port 49a0f089-f785-418c-9210-780bc0f62f14 Aug 01 14:16:03.558168 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-b456eed9-6736-40be-8660-59c6ce5fb261 req-2cb4d045-a1f9-46b7-98a2-e4651d11afc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be944f58-3d1b-43af-bd53-5d0f0c17f6a7", "name": "network-vif-plugged", "status": "completed", "tag": "6557d142-b394-4c3c-b200-64bd14908f59"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:03.572461 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b456eed9-6736-40be-8660-59c6ce5fb261 req-2cb4d045-a1f9-46b7-98a2-e4651d11afc8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:03.573885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b456eed9-6736-40be-8660-59c6ce5fb261 req-2cb4d045-a1f9-46b7-98a2-e4651d11afc8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:03.588135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-b456eed9-6736-40be-8660-59c6ce5fb261 req-2cb4d045-a1f9-46b7-98a2-e4651d11afc8 service nova] Creating event network-vif-plugged:6557d142-b394-4c3c-b200-64bd14908f59 for instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 on hv-cinder-84713 Aug 01 14:16:03.593973 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-b456eed9-6736-40be-8660-59c6ce5fb261 req-2cb4d045-a1f9-46b7-98a2-e4651d11afc8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132628 Aug 01 14:16:03.595545 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 429/858] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:03.849467 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-406b14e0-d304-4546-8e25-7a8aaaeb4764 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:03.850184 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-406b14e0-d304-4546-8e25-7a8aaaeb4764 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:03.853835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:03.874709 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-406b14e0-d304-4546-8e25-7a8aaaeb4764 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:03.875197 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-406b14e0-d304-4546-8e25-7a8aaaeb4764 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:03.878630 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-406b14e0-d304-4546-8e25-7a8aaaeb4764 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:03.881375 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-406b14e0-d304-4546-8e25-7a8aaaeb4764 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:04.145070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6f96f6d2-c872-4643-b7de-5f8ac9cb8663 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "POST /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/action" status: 202 len: 0 microversion: 2.1 time: 1.140162 Aug 01 14:16:04.152653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 430/859] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:16:03 2022] POST /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/action => generated 0 bytes in 1149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:16:04.159157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:04.160184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:04.170247 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:04.171011 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:04.172025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:04.172753 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:04.201295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] HTTP exception thrown: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Request method failure captured: Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf HTTP/1.1 Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi596Dv3VBRbS4bp33CX1l3gzP2Ydck9kFaMkQkbm6YyXFxhtxuFz4GjlWOEEYXCzZRh4NL5QCFLEvw5BEnqWY5oYV_HaRAgNkQuEfR7Am6Y2GkZoi4nSKgpvMU65ffnmdccoTeUKzlz1PQ_mIbmUOM1w8mkP1zk4KgE0dhr2JX38tt6A Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:16:04.204912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}] Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 62cc969defd64837a20e9a7dbda5b4fa Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:16:04.206295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '51fd7ad6-9939-4561-b0fa-f45f8602eccf'} Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:04.207041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:16:04.208212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:04.210461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Returning 404 to user: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:04.211495 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-19eb9594-cc4e-4c7a-92d9-0954de06fcfb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 404 len: 111 microversion: 2.20 time: 0.057524 Aug 01 14:16:04.212562 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 431/860] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:04 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:16:04.218914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-d5a003ac-90be-4ccc-bc52-34ca41f79fd4 req-3612533f-6a33-42d5-b23c-ce849800d3fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0b1caa-a17e-4a0f-b54e-9d0be62f316d", "tag": "49a0f089-f785-418c-9210-780bc0f62f14"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:04.247392 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d5a003ac-90be-4ccc-bc52-34ca41f79fd4 req-3612533f-6a33-42d5-b23c-ce849800d3fb service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:04.249418 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d5a003ac-90be-4ccc-bc52-34ca41f79fd4 req-3612533f-6a33-42d5-b23c-ce849800d3fb service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:04.267659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-406b14e0-d304-4546-8e25-7a8aaaeb4764 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:04.271637 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-d5a003ac-90be-4ccc-bc52-34ca41f79fd4 req-3612533f-6a33-42d5-b23c-ce849800d3fb service nova] Creating event network-changed:49a0f089-f785-418c-9210-780bc0f62f14 for instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d on hv-cinder-84713 Aug 01 14:16:04.281257 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-d5a003ac-90be-4ccc-bc52-34ca41f79fd4 req-3612533f-6a33-42d5-b23c-ce849800d3fb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067042 Aug 01 14:16:04.283168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 432/861] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:04.285367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-406b14e0-d304-4546-8e25-7a8aaaeb4764 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.441050 Aug 01 14:16:04.287391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 430/862] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:03 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:04.290444 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d8ef23d1-938d-4ae6-b10c-c9b1aa56d8ef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '.version_select at 0x7f4462d881f0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:04.323512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d8ef23d1-938d-4ae6-b10c-c9b1aa56d8ef tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1751897942" status: 204 len: 0 microversion: 2.20 time: 0.037617 Aug 01 14:16:04.326113 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 433/863] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Aug 1 14:16:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1751897942 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:16:05.235131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1953337335", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "953311ac-9b59-429f-b3be-74acb6dca2d9"}], "security_groups": [{"name": "tempest-securitygroup--1854739994"}], "key_name": "tempest-keypair-570911533", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:05.309852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6213fdc5-4026-4a8b-857b-47c6422e3827 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:05.310604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6213fdc5-4026-4a8b-857b-47c6422e3827 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:05.319413 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6213fdc5-4026-4a8b-857b-47c6422e3827 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:05.319904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6213fdc5-4026-4a8b-857b-47c6422e3827 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:05.320981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6213fdc5-4026-4a8b-857b-47c6422e3827 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:05.321434 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6213fdc5-4026-4a8b-857b-47c6422e3827 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:05.446511 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] validate_networks() for [('953311ac-9b59-429f-b3be-74acb6dca2d9', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:16:05.531734 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6213fdc5-4026-4a8b-857b-47c6422e3827 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:05.539423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6213fdc5-4026-4a8b-857b-47c6422e3827 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1260 microversion: 2.1 time: 0.236001 Aug 01 14:16:05.540074 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 434/864] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:05 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1260 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:05.544607 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d95c0cd8-a077-4fef-bbbc-955b36c341c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'create', calling method: .version_select at 0x7f4462ded5e0>, body: {"keypair": {"name": "tempest-keypair-1838398321", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEB/lzmUlu1QOX1qSY71v2Olgspc4L/7tHW8iYXFYaWrnVOJQZMesKlMwpyGdf0rSn/FIn12p30QZpvd6eG1Tvi2kP/dd6UJH/fk2dohTWmYGNEbOOUG9mLyzQtMiVZxQ=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:05.562678 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-d95c0cd8-a077-4fef-bbbc-955b36c341c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Getting quotas for project 6d4402cabc4b41e0aec0ccc40cdd17cc. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:16:05.566773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-d95c0cd8-a077-4fef-bbbc-955b36c341c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Getting quotas for user 62cc969defd64837a20e9a7dbda5b4fa and project 6d4402cabc4b41e0aec0ccc40cdd17cc. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:16:05.591491 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d95c0cd8-a077-4fef-bbbc-955b36c341c1 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.050346 Aug 01 14:16:05.592745 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 435/865] 10.222.0.48 () {62 vars in 1200 bytes} [Mon Aug 1 14:16:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 01 14:16:06.131109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f9db91cc-c8b1-4253-9c6b-365e0f8fc994 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:06.131815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f9db91cc-c8b1-4253-9c6b-365e0f8fc994 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:06.145537 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f9db91cc-c8b1-4253-9c6b-365e0f8fc994 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.147115 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f9db91cc-c8b1-4253-9c6b-365e0f8fc994 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.148090 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f9db91cc-c8b1-4253-9c6b-365e0f8fc994 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.149305 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f9db91cc-c8b1-4253-9c6b-365e0f8fc994 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.266080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-f9db91cc-c8b1-4253-9c6b-365e0f8fc994 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lazy-loading 'services' on Instance uuid 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:16:06.361885 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f9db91cc-c8b1-4253-9c6b-365e0f8fc994 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments/04622d17-5bd4-4c9e-bdde-92194c25b009" status: 202 len: 0 microversion: 2.1 time: 0.235129 Aug 01 14:16:06.368842 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 436/866] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:16:06 2022] DELETE /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments/04622d17-5bd4-4c9e-bdde-92194c25b009 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:16:06.379735 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-04e90539-5336-4239-94ee-c102ebde227c req-ddff5f3d-5c9d-4e77-a024-2e899afc9b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b0b1caa-a17e-4a0f-b54e-9d0be62f316d", "tag": "49a0f089-f785-418c-9210-780bc0f62f14"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:06.388365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:06.406087 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-04e90539-5336-4239-94ee-c102ebde227c req-ddff5f3d-5c9d-4e77-a024-2e899afc9b2e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.407771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-04e90539-5336-4239-94ee-c102ebde227c req-ddff5f3d-5c9d-4e77-a024-2e899afc9b2e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.431461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-04e90539-5336-4239-94ee-c102ebde227c req-ddff5f3d-5c9d-4e77-a024-2e899afc9b2e service nova] Creating event network-changed:49a0f089-f785-418c-9210-780bc0f62f14 for instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d on hv-cinder-84713 Aug 01 14:16:06.438486 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-04e90539-5336-4239-94ee-c102ebde227c req-ddff5f3d-5c9d-4e77-a024-2e899afc9b2e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067840 Aug 01 14:16:06.439662 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 437/867] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:06.445706 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-067fdfee-435c-447d-aaa2-faa86fd2322e tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:06.448327 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-067fdfee-435c-447d-aaa2-faa86fd2322e tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:06.462671 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-067fdfee-435c-447d-aaa2-faa86fd2322e tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.463295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-067fdfee-435c-447d-aaa2-faa86fd2322e tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.464283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-067fdfee-435c-447d-aaa2-faa86fd2322e tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.464964 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-067fdfee-435c-447d-aaa2-faa86fd2322e tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.500584 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-067fdfee-435c-447d-aaa2-faa86fd2322e tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059447 Aug 01 14:16:06.501462 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 438/868] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:16:06 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:06.562248 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0c3591af-e142-431f-919d-8db2b3c50893 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:06.562875 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0c3591af-e142-431f-919d-8db2b3c50893 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:06.571512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0c3591af-e142-431f-919d-8db2b3c50893 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.575407 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0c3591af-e142-431f-919d-8db2b3c50893 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.576210 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0c3591af-e142-431f-919d-8db2b3c50893 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.577398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0c3591af-e142-431f-919d-8db2b3c50893 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.602805 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:16:06.610465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:16:06.611443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:16:06.613342 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:16:06.613915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:16:06.625923 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.626484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.627395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.627934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.647022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for project a3203f080a05422e83090a1f0a31d1a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:16:06.651297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for user ca3cd1c2aec94b43aff0034b812a069d and project a3203f080a05422e83090a1f0a31d1a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:16:06.662964 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:16:06.665588 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:16:06.720728 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bc2e20e9-367a-498c-90ba-872198396962 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.490159 Aug 01 14:16:06.722270 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 431/869] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:16:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 1492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:16:06.740547 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f7d24f8b-17af-457f-8f84-da8e0e2926e1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:06.741680 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f7d24f8b-17af-457f-8f84-da8e0e2926e1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:06.813374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f7d24f8b-17af-457f-8f84-da8e0e2926e1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:06.825226 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f7d24f8b-17af-457f-8f84-da8e0e2926e1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1241 microversion: 2.1 time: 0.090172 Aug 01 14:16:06.826953 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 432/870] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:06 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:06.852404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0c3591af-e142-431f-919d-8db2b3c50893 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:06.864156 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0c3591af-e142-431f-919d-8db2b3c50893 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1444 microversion: 2.1 time: 0.306905 Aug 01 14:16:06.880825 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 439/871] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:06 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1444 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:06.885021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-38243b71-7b42-4633-b40e-3cd9e26c8e0a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:06.885744 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-38243b71-7b42-4633-b40e-3cd9e26c8e0a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:06.894281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38243b71-7b42-4633-b40e-3cd9e26c8e0a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.894809 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38243b71-7b42-4633-b40e-3cd9e26c8e0a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.896241 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38243b71-7b42-4633-b40e-3cd9e26c8e0a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:06.896733 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38243b71-7b42-4633-b40e-3cd9e26c8e0a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:06.926442 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:07.168261 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-38243b71-7b42-4633-b40e-3cd9e26c8e0a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:07.187393 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-38243b71-7b42-4633-b40e-3cd9e26c8e0a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1444 microversion: 2.1 time: 0.302907 Aug 01 14:16:07.191006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 433/872] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:06 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1444 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:07.285670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-465271824", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb61fa02-09d7-4db2-9187-e0278beee81d"}], "security_groups": [{"name": "tempest-securitygroup--696716266"}], "key_name": "tempest-keypair-1838398321", "user_data": "}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:07.430348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] validate_networks() for [('bb61fa02-09d7-4db2-9187-e0278beee81d', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:16:07.521538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-851277fa-6ab3-4b32-a138-7b5dc0a47feb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:07.527058 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-851277fa-6ab3-4b32-a138-7b5dc0a47feb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:07.536899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-851277fa-6ab3-4b32-a138-7b5dc0a47feb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:07.537631 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-851277fa-6ab3-4b32-a138-7b5dc0a47feb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:07.538443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-851277fa-6ab3-4b32-a138-7b5dc0a47feb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:07.538869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-851277fa-6ab3-4b32-a138-7b5dc0a47feb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:07.575817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-851277fa-6ab3-4b32-a138-7b5dc0a47feb tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063637 Aug 01 14:16:07.583509 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 434/873] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:16:07 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:07.847518 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6efb767a-d887-426b-b0cb-3f01d5f94cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:07.848416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6efb767a-d887-426b-b0cb-3f01d5f94cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:07.855385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6efb767a-d887-426b-b0cb-3f01d5f94cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:07.856041 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6efb767a-d887-426b-b0cb-3f01d5f94cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:07.857006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6efb767a-d887-426b-b0cb-3f01d5f94cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:07.857537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6efb767a-d887-426b-b0cb-3f01d5f94cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:07.936456 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6efb767a-d887-426b-b0cb-3f01d5f94cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:07.945077 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6efb767a-d887-426b-b0cb-3f01d5f94cbf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1293 microversion: 2.1 time: 0.100970 Aug 01 14:16:07.945327 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 435/874] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:07 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:08.167552 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:16:08.168447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:16:08.169186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:16:08.169819 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:16:08.171220 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:16:08.184348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.185081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.186642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.187241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.209911 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Getting quotas for project 6d4402cabc4b41e0aec0ccc40cdd17cc. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:16:08.214484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Getting quotas for user 62cc969defd64837a20e9a7dbda5b4fa and project 6d4402cabc4b41e0aec0ccc40cdd17cc. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:16:08.226545 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:16:08.228851 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:16:08.281991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7b342e29-d8ba-46e3-8ef7-57abdded0609 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.001190 Aug 01 14:16:08.282674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 440/875] 10.222.0.48 () {62 vars in 1188 bytes} [Mon Aug 1 14:16:07 2022] POST /compute/v2.1/servers => generated 401 bytes in 1003 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 01 14:16:08.294539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d67a8620-fabe-423f-a0c3-9bc24921cb6a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:08.295188 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d67a8620-fabe-423f-a0c3-9bc24921cb6a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:08.407295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d67a8620-fabe-423f-a0c3-9bc24921cb6a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:08.414937 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d67a8620-fabe-423f-a0c3-9bc24921cb6a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:08.416802 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d67a8620-fabe-423f-a0c3-9bc24921cb6a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:08.418373 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d67a8620-fabe-423f-a0c3-9bc24921cb6a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1281 microversion: 2.20 time: 0.128456 Aug 01 14:16:08.419136 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 436/876] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:08 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1281 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:08.591180 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e4426ebc-7599-446c-a602-37008161b8e6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:08.595080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e4426ebc-7599-446c-a602-37008161b8e6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:08.603553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e4426ebc-7599-446c-a602-37008161b8e6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.604325 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e4426ebc-7599-446c-a602-37008161b8e6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.605329 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e4426ebc-7599-446c-a602-37008161b8e6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.605967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e4426ebc-7599-446c-a602-37008161b8e6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.638530 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e4426ebc-7599-446c-a602-37008161b8e6 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053507 Aug 01 14:16:08.639826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 441/877] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:16:08 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:16:08.651260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:08.652171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:08.661098 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.661577 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.662737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.663198 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.743857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] HTTP exception thrown: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d is not attached to volume 04622d17-5bd4-4c9e-bdde-92194c25b009 Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Request method failure captured: Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments/04622d17-5bd4-4c9e-bdde-92194c25b009 HTTP/1.1 Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi597PbYMSzRFif55GDVG2OIcn8BDK13gHaVLN3yHWiIJB2awLnLF8YtDRgpvZPdp2ac8irxtuPxVJR6zyD4u6_gweFnzMCFNonl9a6i4PBjJrtfWyspovJQ2EsEWJ-6EdQOE_Ov2LhZTlnNEk_RQC_NlNq5upRbbnZpCpdaaKcSSXOEs Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a8630c7be7ea49d5b6d3ef6d46fd653e Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestMinimumBasicScenario-1317714281 Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:16:08.746921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a8630c7be7ea49d5b6d3ef6d46fd653e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8630c7be7ea49d5b6d3ef6d46fd653e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a8630c7be7ea49d5b6d3ef6d46fd653e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8630c7be7ea49d5b6d3ef6d46fd653e"}]}] Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestMinimumBasicScenario-1317714281 Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a8630c7be7ea49d5b6d3ef6d46fd653e Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1317714281 Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-TestMinimumBasicScenario-1317714281-project Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: b6ed2d0b015d4fe39d780306d04fba4d Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestMinimumBasicScenario-1317714281-project Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:16:08.748647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d is not attached to volume 04622d17-5bd4-4c9e-bdde-92194c25b009 Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'server_id': '1b0b1caa-a17e-4a0f-b54e-9d0be62f316d', 'id': '04622d17-5bd4-4c9e-bdde-92194c25b009'} Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 04622d17-5bd4-4c9e-bdde-92194c25b009. Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:08.749559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d is not attached to volume 04622d17-5bd4-4c9e-bdde-92194c25b009 Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d is not attached to volume 04622d17-5bd4-4c9e-bdde-92194c25b009 Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:16:08.750955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Returning 404 to user: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d is not attached to volume 04622d17-5bd4-4c9e-bdde-92194c25b009 {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:08.752227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-364a325e-30c6-4169-9082-476f4d4315c5 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments/04622d17-5bd4-4c9e-bdde-92194c25b009" status: 404 len: 154 microversion: 2.1 time: 0.102173 Aug 01 14:16:08.753618 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 437/878] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:16:08 2022] DELETE /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d/os-volume_attachments/04622d17-5bd4-4c9e-bdde-92194c25b009 => generated 154 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:16:08.966958 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-23cc7d4e-72c2-43f1-b1df-a1b3e3dce8bc tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:08.967571 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-23cc7d4e-72c2-43f1-b1df-a1b3e3dce8bc tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:08.975200 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-23cc7d4e-72c2-43f1-b1df-a1b3e3dce8bc tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.975642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-23cc7d4e-72c2-43f1-b1df-a1b3e3dce8bc tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:08.977121 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-23cc7d4e-72c2-43f1-b1df-a1b3e3dce8bc tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:08.977598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-23cc7d4e-72c2-43f1-b1df-a1b3e3dce8bc tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:09.042486 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-23cc7d4e-72c2-43f1-b1df-a1b3e3dce8bc tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:09.050482 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-23cc7d4e-72c2-43f1-b1df-a1b3e3dce8bc tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1299 microversion: 2.1 time: 0.087420 Aug 01 14:16:09.051089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 442/879] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:08 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:09.445182 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:09.446479 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:09.454707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:09.454707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:09.455198 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:09.455642 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:09.612159 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:09.621490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:09.622998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:09.624313 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-570c38ac-5c7b-4560-9985-b40b110bd820 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1333 microversion: 2.20 time: 0.184291 Aug 01 14:16:09.636770 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 438/880] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:09 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1333 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:09.907564 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-49c8c20c-9bf3-4afb-845e-85d7d4153fff tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:09.908087 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-49c8c20c-9bf3-4afb-845e-85d7d4153fff tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:09.914825 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-49c8c20c-9bf3-4afb-845e-85d7d4153fff tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:09.915281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-49c8c20c-9bf3-4afb-845e-85d7d4153fff tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:09.916069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-49c8c20c-9bf3-4afb-845e-85d7d4153fff tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:09.916531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-49c8c20c-9bf3-4afb-845e-85d7d4153fff tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:09.942937 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-49c8c20c-9bf3-4afb-845e-85d7d4153fff tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:16:10.024644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-49c8c20c-9bf3-4afb-845e-85d7d4153fff tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 204 len: 0 microversion: 2.1 time: 0.120953 Aug 01 14:16:10.025644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 443/881] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:16:09 2022] DELETE /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:16:10.035808 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c350b9a9-8695-458d-9d20-4176a5109cfe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:10.036786 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c350b9a9-8695-458d-9d20-4176a5109cfe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:10.046794 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c350b9a9-8695-458d-9d20-4176a5109cfe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:10.047260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c350b9a9-8695-458d-9d20-4176a5109cfe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:10.048053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c350b9a9-8695-458d-9d20-4176a5109cfe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:10.048523 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c350b9a9-8695-458d-9d20-4176a5109cfe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:10.074741 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-db9f7c23-4a3d-4c90-a96e-5d57bd555dd6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:10.075461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-db9f7c23-4a3d-4c90-a96e-5d57bd555dd6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:10.082522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-db9f7c23-4a3d-4c90-a96e-5d57bd555dd6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:10.082998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-db9f7c23-4a3d-4c90-a96e-5d57bd555dd6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:10.083795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-db9f7c23-4a3d-4c90-a96e-5d57bd555dd6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:10.084225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-db9f7c23-4a3d-4c90-a96e-5d57bd555dd6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:10.104240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:10.222829 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-db9f7c23-4a3d-4c90-a96e-5d57bd555dd6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:10.231913 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-db9f7c23-4a3d-4c90-a96e-5d57bd555dd6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.163077 Aug 01 14:16:10.241115 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 444/882] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:10 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:10.389522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c350b9a9-8695-458d-9d20-4176a5109cfe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:10.397602 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c350b9a9-8695-458d-9d20-4176a5109cfe tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1553 microversion: 2.1 time: 0.366428 Aug 01 14:16:10.398198 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 439/883] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:10 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1553 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:10.647421 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:10.648041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:10.661646 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-699b8fbd-89a6-4094-b887-d0f71f6016a1 req-88585179-f92b-4f31-ad5c-f71dad4b57a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be944f58-3d1b-43af-bd53-5d0f0c17f6a7", "tag": "6557d142-b394-4c3c-b200-64bd14908f59"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:10.670727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:10.671182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:10.671963 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:10.672436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:10.672585 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-699b8fbd-89a6-4094-b887-d0f71f6016a1 req-88585179-f92b-4f31-ad5c-f71dad4b57a4 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:10.672959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-699b8fbd-89a6-4094-b887-d0f71f6016a1 req-88585179-f92b-4f31-ad5c-f71dad4b57a4 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:10.686828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-699b8fbd-89a6-4094-b887-d0f71f6016a1 req-88585179-f92b-4f31-ad5c-f71dad4b57a4 service nova] Creating event network-changed:6557d142-b394-4c3c-b200-64bd14908f59 for instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 on hv-cinder-84713 Aug 01 14:16:10.691829 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-699b8fbd-89a6-4094-b887-d0f71f6016a1 req-88585179-f92b-4f31-ad5c-f71dad4b57a4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034000 Aug 01 14:16:10.692562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 440/884] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:10.734436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:10.742387 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:10.743904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:10.745036 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-347408f9-fed6-4691-9300-3daba56085b0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1339 microversion: 2.20 time: 0.101840 Aug 01 14:16:10.745604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 445/885] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:10 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:11.255849 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a241b217-744e-46fa-bbba-877f55308baa tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:11.256614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a241b217-744e-46fa-bbba-877f55308baa tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:11.262853 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a241b217-744e-46fa-bbba-877f55308baa tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.263297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a241b217-744e-46fa-bbba-877f55308baa tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.264129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a241b217-744e-46fa-bbba-877f55308baa tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.264591 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a241b217-744e-46fa-bbba-877f55308baa tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.398396 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a241b217-744e-46fa-bbba-877f55308baa tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:11.406357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a241b217-744e-46fa-bbba-877f55308baa tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.154764 Aug 01 14:16:11.406926 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 441/886] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:11 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:11.423959 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-af7c5ffa-10b2-4b03-b1e2-607ebcb40070 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:11.424695 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-af7c5ffa-10b2-4b03-b1e2-607ebcb40070 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:11.431623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-af7c5ffa-10b2-4b03-b1e2-607ebcb40070 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.432396 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-af7c5ffa-10b2-4b03-b1e2-607ebcb40070 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.433212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-af7c5ffa-10b2-4b03-b1e2-607ebcb40070 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.433652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-af7c5ffa-10b2-4b03-b1e2-607ebcb40070 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.674992 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-af7c5ffa-10b2-4b03-b1e2-607ebcb40070 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:11.689240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-af7c5ffa-10b2-4b03-b1e2-607ebcb40070 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1553 microversion: 2.1 time: 0.269284 Aug 01 14:16:11.689766 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 446/887] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:11 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1553 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:11.768234 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:11.769309 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:11.775476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.775987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.777003 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:11.777444 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:11.866496 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:11.875618 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:11.877215 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:11.878321 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5b7e4f74-aea1-49ef-8c73-f8ceeb95f05f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1339 microversion: 2.20 time: 0.114068 Aug 01 14:16:11.878893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 442/888] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:11 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1339 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:12.431295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1ad17cd6-45a2-437e-8c0b-ec4ba43d5f45 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:12.431916 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1ad17cd6-45a2-437e-8c0b-ec4ba43d5f45 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:12.438362 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1ad17cd6-45a2-437e-8c0b-ec4ba43d5f45 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.438810 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1ad17cd6-45a2-437e-8c0b-ec4ba43d5f45 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:12.439619 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1ad17cd6-45a2-437e-8c0b-ec4ba43d5f45 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.441201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1ad17cd6-45a2-437e-8c0b-ec4ba43d5f45 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:12.598056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1ad17cd6-45a2-437e-8c0b-ec4ba43d5f45 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:12.605891 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1ad17cd6-45a2-437e-8c0b-ec4ba43d5f45 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.178370 Aug 01 14:16:12.606468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 447/889] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:12 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:12.712306 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-87ae272e-5cf9-4922-9e4d-2ca931697917 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:12.713105 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-87ae272e-5cf9-4922-9e4d-2ca931697917 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:12.721883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87ae272e-5cf9-4922-9e4d-2ca931697917 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.722332 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87ae272e-5cf9-4922-9e4d-2ca931697917 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:12.723482 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87ae272e-5cf9-4922-9e4d-2ca931697917 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.723943 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87ae272e-5cf9-4922-9e4d-2ca931697917 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:12.729436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-cdbc596e-d952-4f34-bdd7-a2b02ac74698 req-be0a5ad6-8815-4653-8055-f6583d9c1cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a6965a-e41a-44e6-8317-3a420f00e98f", "tag": "ebafe7aa-c8e3-4a0e-9296-a84b979fd578"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:12.740768 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-cdbc596e-d952-4f34-bdd7-a2b02ac74698 req-be0a5ad6-8815-4653-8055-f6583d9c1cd6 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.750325 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-cdbc596e-d952-4f34-bdd7-a2b02ac74698 req-be0a5ad6-8815-4653-8055-f6583d9c1cd6 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:12.783215 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-cdbc596e-d952-4f34-bdd7-a2b02ac74698 req-be0a5ad6-8815-4653-8055-f6583d9c1cd6 service nova] Creating event network-changed:ebafe7aa-c8e3-4a0e-9296-a84b979fd578 for instance a0a6965a-e41a-44e6-8317-3a420f00e98f on hv-cinder-84713 Aug 01 14:16:12.788878 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-cdbc596e-d952-4f34-bdd7-a2b02ac74698 req-be0a5ad6-8815-4653-8055-f6583d9c1cd6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063762 Aug 01 14:16:12.789694 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 448/890] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:12.902502 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:12.903217 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:12.914877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.915335 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:12.916133 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:12.916596 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:13.066506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:13.076191 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:13.077769 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:13.078909 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d0d7d0d4-98f4-4ba2-ab3d-b0548412c13a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.181107 Aug 01 14:16:13.079877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 449/891] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:12 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:13.159774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87ae272e-5cf9-4922-9e4d-2ca931697917 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6ed2d0b015d4fe39d780306d04fba4d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8630c7be7ea49d5b6d3ef6d46fd653e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:13.167768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-87ae272e-5cf9-4922-9e4d-2ca931697917 tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 200 len: 1553 microversion: 2.1 time: 0.459232 Aug 01 14:16:13.168348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 443/892] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:12 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 1553 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:13.627550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-97cad0e2-2001-48f4-9005-cb954eddcfff tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:13.628456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-97cad0e2-2001-48f4-9005-cb954eddcfff tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:13.635599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-97cad0e2-2001-48f4-9005-cb954eddcfff tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:13.636066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-97cad0e2-2001-48f4-9005-cb954eddcfff tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:13.637084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-97cad0e2-2001-48f4-9005-cb954eddcfff tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:13.637534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-97cad0e2-2001-48f4-9005-cb954eddcfff tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:13.779574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-97cad0e2-2001-48f4-9005-cb954eddcfff tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:13.787697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-97cad0e2-2001-48f4-9005-cb954eddcfff tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.164256 Aug 01 14:16:13.800590 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 450/893] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:13 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:14.103635 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:14.104166 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:14.110710 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:14.111157 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:14.111914 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:14.112346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:14.190415 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:14.191041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] [instance: 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:14.197301 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:14.197751 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:14.198542 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:14.199230 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:14.213123 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] HTTP exception thrown: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d could not be found. Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Request method failure captured: Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d HTTP/1.1 Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi597PbYMSzRFif55GDVG2OIcn8BDK13gHaVLN3yHWiIJB2awLnLF8YtDRgpvZPdp2ac8irxtuPxVJR6zyD4u6_gweFnzMCFNonl9a6i4PBjJrtfWyspovJQ2EsEWJ-6EdQOE_Ov2LhZTlnNEk_RQC_NlNq5upRbbnZpCpdaaKcSSXOEs Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: a8630c7be7ea49d5b6d3ef6d46fd653e Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-TestMinimumBasicScenario-1317714281 Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:16:14.214796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a8630c7be7ea49d5b6d3ef6d46fd653e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8630c7be7ea49d5b6d3ef6d46fd653e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a8630c7be7ea49d5b6d3ef6d46fd653e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a8630c7be7ea49d5b6d3ef6d46fd653e"}]}] Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-TestMinimumBasicScenario-1317714281 Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: a8630c7be7ea49d5b6d3ef6d46fd653e Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1317714281 Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-TestMinimumBasicScenario-1317714281-project Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: b6ed2d0b015d4fe39d780306d04fba4d Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-TestMinimumBasicScenario-1317714281-project Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d could not be found. Aug 01 14:16:14.216271 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '1b0b1caa-a17e-4a0f-b54e-9d0be62f316d'} Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d could not be found. Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:14.217106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d could not be found. Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d could not be found. Aug 01 14:16:14.218319 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:14.219437 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Returning 404 to user: Instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:14.219437 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ee2cfbb2-9ea5-49b9-b5fa-65c9e1c3a8cf tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d" status: 404 len: 111 microversion: 2.1 time: 0.029727 Aug 01 14:16:14.219437 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 451/894] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:14 2022] GET /compute/v2.1/servers/1b0b1caa-a17e-4a0f-b54e-9d0be62f316d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:16:14.225061 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-77f3f472-3fdb-40aa-8de4-30b9ffcbca8c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] Calling method '.version_select at 0x7f4462d59b80>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:14.243959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:14.244749 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-77f3f472-3fdb-40aa-8de4-30b9ffcbca8c tempest-TestMinimumBasicScenario-1317714281 tempest-TestMinimumBasicScenario-1317714281-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-982853475" status: 202 len: 0 microversion: 2.1 time: 0.022994 Aug 01 14:16:14.245356 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 452/895] 10.222.0.48 () {58 vars in 1269 bytes} [Mon Aug 1 14:16:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-982853475 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:16:14.253283 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:14.254792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:14.255890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-87729f8b-f499-46b2-8559-4d87a38a601d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.156248 Aug 01 14:16:14.256779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 444/896] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:14 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:14.809734 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-839875ae-94d3-4467-aa05-3bd08d4370bb tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:14.810896 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-839875ae-94d3-4467-aa05-3bd08d4370bb tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:14.819357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-839875ae-94d3-4467-aa05-3bd08d4370bb tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:14.819357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-839875ae-94d3-4467-aa05-3bd08d4370bb tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:14.819998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-839875ae-94d3-4467-aa05-3bd08d4370bb tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:14.820437 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-839875ae-94d3-4467-aa05-3bd08d4370bb tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:14.832257 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-66989c38-183e-450e-8abf-009a0c4adf9d req-2c3fc3f4-28b8-43b4-9f98-11a5a213e8be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b0b1caa-a17e-4a0f-b54e-9d0be62f316d", "name": "network-vif-deleted", "tag": "49a0f089-f785-418c-9210-780bc0f62f14"}, {"name": "network-changed", "server_uuid": "900b90f4-dd21-4df9-a880-5760f2c62ae5", "tag": "27822eab-07c3-4ba4-b4e4-e82eaa97336f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:14.843335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-66989c38-183e-450e-8abf-009a0c4adf9d req-2c3fc3f4-28b8-43b4-9f98-11a5a213e8be service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:14.843779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-66989c38-183e-450e-8abf-009a0c4adf9d req-2c3fc3f4-28b8-43b4-9f98-11a5a213e8be service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:14.859090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-66989c38-183e-450e-8abf-009a0c4adf9d req-2c3fc3f4-28b8-43b4-9f98-11a5a213e8be service nova] Creating event network-vif-deleted:49a0f089-f785-418c-9210-780bc0f62f14 for instance 1b0b1caa-a17e-4a0f-b54e-9d0be62f316d on hv-cinder-84713 Aug 01 14:16:14.859525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-66989c38-183e-450e-8abf-009a0c4adf9d req-2c3fc3f4-28b8-43b4-9f98-11a5a213e8be service nova] Creating event network-changed:27822eab-07c3-4ba4-b4e4-e82eaa97336f for instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 on hv-cinder-84713 Aug 01 14:16:14.865875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-66989c38-183e-450e-8abf-009a0c4adf9d req-2c3fc3f4-28b8-43b4-9f98-11a5a213e8be service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.037503 Aug 01 14:16:14.866484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 445/897] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:15.036382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-839875ae-94d3-4467-aa05-3bd08d4370bb tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:15.043933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-839875ae-94d3-4467-aa05-3bd08d4370bb tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.238446 Aug 01 14:16:15.044725 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 453/898] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:14 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:15.281753 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:15.282895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:15.292368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:15.292853 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:15.293656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:15.294096 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:15.425377 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:15.433407 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:15.434803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:15.436457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ae73b295-e8b4-426f-af5e-8374604ac905 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.161006 Aug 01 14:16:15.437038 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 446/899] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:15 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:16.064524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a353dc3a-53f1-42e8-b3a9-8faae5f770c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:16.065149 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a353dc3a-53f1-42e8-b3a9-8faae5f770c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:16.071848 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a353dc3a-53f1-42e8-b3a9-8faae5f770c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:16.072313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a353dc3a-53f1-42e8-b3a9-8faae5f770c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:16.073119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a353dc3a-53f1-42e8-b3a9-8faae5f770c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:16.073550 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a353dc3a-53f1-42e8-b3a9-8faae5f770c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:16.273492 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a353dc3a-53f1-42e8-b3a9-8faae5f770c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:16.281627 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a353dc3a-53f1-42e8-b3a9-8faae5f770c4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.221091 Aug 01 14:16:16.282216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 454/900] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:16 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:16.460036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:16.460811 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:16.467884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:16.468351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:16.469281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:16.469726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:16.636671 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:16.641424 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:16.649817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:16.651357 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:16.652726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-10311b22-ac49-48ea-a339-0f6e85cd30c2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.197037 Aug 01 14:16:16.653285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 447/901] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:16 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:17.304750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9bd2f4af-88f6-43ed-a502-550d46b23dcf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:17.306132 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9bd2f4af-88f6-43ed-a502-550d46b23dcf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:17.318982 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9bd2f4af-88f6-43ed-a502-550d46b23dcf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:17.319986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9bd2f4af-88f6-43ed-a502-550d46b23dcf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:17.322676 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9bd2f4af-88f6-43ed-a502-550d46b23dcf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:17.323446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9bd2f4af-88f6-43ed-a502-550d46b23dcf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:17.595386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9bd2f4af-88f6-43ed-a502-550d46b23dcf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:17.604589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9bd2f4af-88f6-43ed-a502-550d46b23dcf tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.305261 Aug 01 14:16:17.605463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 455/902] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:17 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:17.677143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:17.678175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:17.684938 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:17.685710 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:17.686741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:17.687412 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:17.843992 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e6561c10-00d1-4c26-8043-f07748bc23a3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:17.844871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e6561c10-00d1-4c26-8043-f07748bc23a3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:17.852243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e6561c10-00d1-4c26-8043-f07748bc23a3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:17.852764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e6561c10-00d1-4c26-8043-f07748bc23a3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:17.853548 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e6561c10-00d1-4c26-8043-f07748bc23a3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:17.853988 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e6561c10-00d1-4c26-8043-f07748bc23a3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:17.889190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e6561c10-00d1-4c26-8043-f07748bc23a3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:16:17.976364 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:17.987892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:17.996432 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:17.997813 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c50b0037-89d0-4c1c-a55d-e583ee25eb5c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.324484 Aug 01 14:16:18.000125 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 448/903] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:17 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:18.054371 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e6561c10-00d1-4c26-8043-f07748bc23a3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 204 len: 0 microversion: 2.1 time: 0.215327 Aug 01 14:16:18.055324 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 456/904] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:16:17 2022] DELETE /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:16:18.064213 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d203a695-f759-4b9f-849d-29456a3139d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:18.065162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d203a695-f759-4b9f-849d-29456a3139d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:18.075253 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d203a695-f759-4b9f-849d-29456a3139d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:18.076605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d203a695-f759-4b9f-849d-29456a3139d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:18.077826 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d203a695-f759-4b9f-849d-29456a3139d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:18.078416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d203a695-f759-4b9f-849d-29456a3139d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:18.289135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d203a695-f759-4b9f-849d-29456a3139d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:18.301059 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d203a695-f759-4b9f-849d-29456a3139d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1576 microversion: 2.1 time: 0.240203 Aug 01 14:16:18.309668 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 449/905] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:18 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1576 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:18.625907 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-22e4cc5e-ef55-46f1-ad62-e4aba5ccabee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:18.626902 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-22e4cc5e-ef55-46f1-ad62-e4aba5ccabee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:18.629804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:18.630705 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=10 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:18.635604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22e4cc5e-ef55-46f1-ad62-e4aba5ccabee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:18.636144 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22e4cc5e-ef55-46f1-ad62-e4aba5ccabee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:18.637016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22e4cc5e-ef55-46f1-ad62-e4aba5ccabee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:18.637519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22e4cc5e-ef55-46f1-ad62-e4aba5ccabee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:18.777388 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-22e4cc5e-ef55-46f1-ad62-e4aba5ccabee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:18.785321 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-22e4cc5e-ef55-46f1-ad62-e4aba5ccabee tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.164041 Aug 01 14:16:18.785896 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 457/906] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:18 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:19.020737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:19.021364 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:19.023228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=14 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:19.029676 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:19.030131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:19.030901 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:19.031337 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:19.244236 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:19.252210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:19.253830 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:19.254929 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-135df5b1-bc47-4741-b551-2d5d5f608d6e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.238230 Aug 01 14:16:19.255487 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 450/907] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:19 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:19.324038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ba6df975-3343-4b5f-ad64-98a4cbeb3d81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:19.324712 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ba6df975-3343-4b5f-ad64-98a4cbeb3d81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:19.331593 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba6df975-3343-4b5f-ad64-98a4cbeb3d81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:19.332042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba6df975-3343-4b5f-ad64-98a4cbeb3d81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:19.332839 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba6df975-3343-4b5f-ad64-98a4cbeb3d81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:19.333282 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba6df975-3343-4b5f-ad64-98a4cbeb3d81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:19.477038 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ba6df975-3343-4b5f-ad64-98a4cbeb3d81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:19.484630 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ba6df975-3343-4b5f-ad64-98a4cbeb3d81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1576 microversion: 2.1 time: 0.164789 Aug 01 14:16:19.485210 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 458/908] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:19 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:19.785459 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-449f2c62-b31e-4102-bd5c-751bd3d497dc req-ad901525-c6c7-45e0-961c-e8d469daa25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a6965a-e41a-44e6-8317-3a420f00e98f", "name": "network-vif-plugged", "status": "completed", "tag": "ebafe7aa-c8e3-4a0e-9296-a84b979fd578"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:19.809027 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-449f2c62-b31e-4102-bd5c-751bd3d497dc req-ad901525-c6c7-45e0-961c-e8d469daa25e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:19.810322 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-449f2c62-b31e-4102-bd5c-751bd3d497dc req-ad901525-c6c7-45e0-961c-e8d469daa25e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:19.811252 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d2d57a1b-67d0-4a22-83cf-e328d5716b20 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:19.812115 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d2d57a1b-67d0-4a22-83cf-e328d5716b20 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:19.824563 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2d57a1b-67d0-4a22-83cf-e328d5716b20 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:19.825377 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2d57a1b-67d0-4a22-83cf-e328d5716b20 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:19.826372 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2d57a1b-67d0-4a22-83cf-e328d5716b20 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:19.827016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d2d57a1b-67d0-4a22-83cf-e328d5716b20 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:19.834045 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-449f2c62-b31e-4102-bd5c-751bd3d497dc req-ad901525-c6c7-45e0-961c-e8d469daa25e service nova] Creating event network-vif-plugged:ebafe7aa-c8e3-4a0e-9296-a84b979fd578 for instance a0a6965a-e41a-44e6-8317-3a420f00e98f on hv-cinder-84713 Aug 01 14:16:19.841466 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-449f2c62-b31e-4102-bd5c-751bd3d497dc req-ad901525-c6c7-45e0-961c-e8d469daa25e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059254 Aug 01 14:16:19.843821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 451/909] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:19.991270 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d2d57a1b-67d0-4a22-83cf-e328d5716b20 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:20.001086 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d2d57a1b-67d0-4a22-83cf-e328d5716b20 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.197600 Aug 01 14:16:20.002088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 459/910] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:19 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:20.279760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:20.281223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:20.290754 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:20.291415 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:20.292611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:20.293262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:20.506635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b5c5f79e-ab0f-4be3-aa74-4f2d7e7eeb4f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:20.507286 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b5c5f79e-ab0f-4be3-aa74-4f2d7e7eeb4f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:20.514199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5c5f79e-ab0f-4be3-aa74-4f2d7e7eeb4f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:20.514653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5c5f79e-ab0f-4be3-aa74-4f2d7e7eeb4f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:20.515534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5c5f79e-ab0f-4be3-aa74-4f2d7e7eeb4f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:20.515983 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5c5f79e-ab0f-4be3-aa74-4f2d7e7eeb4f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:20.659614 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b5c5f79e-ab0f-4be3-aa74-4f2d7e7eeb4f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:20.668004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b5c5f79e-ab0f-4be3-aa74-4f2d7e7eeb4f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1576 microversion: 2.1 time: 0.165148 Aug 01 14:16:20.668845 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 460/911] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:20 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:20.747848 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:20.755925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:20.757510 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:20.758613 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b4938b98-bc0d-4823-a9e0-3e092aa81f7c tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.484381 Aug 01 14:16:20.759179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 452/912] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:20 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:21.022048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-26858ca1-fc1f-4e86-9b96-07aa94793771 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:21.022702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-26858ca1-fc1f-4e86-9b96-07aa94793771 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:21.030592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-26858ca1-fc1f-4e86-9b96-07aa94793771 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:21.031077 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-26858ca1-fc1f-4e86-9b96-07aa94793771 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:21.031861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-26858ca1-fc1f-4e86-9b96-07aa94793771 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:21.032322 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-26858ca1-fc1f-4e86-9b96-07aa94793771 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:21.167095 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-26858ca1-fc1f-4e86-9b96-07aa94793771 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:21.171190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:21.176617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-26858ca1-fc1f-4e86-9b96-07aa94793771 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.158431 Aug 01 14:16:21.177378 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 461/913] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:21 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:21.690646 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-73070ffa-65a1-4858-8566-fdee3004230c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:21.691825 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-73070ffa-65a1-4858-8566-fdee3004230c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:21.698623 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73070ffa-65a1-4858-8566-fdee3004230c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:21.699243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73070ffa-65a1-4858-8566-fdee3004230c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:21.700235 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73070ffa-65a1-4858-8566-fdee3004230c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:21.701314 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73070ffa-65a1-4858-8566-fdee3004230c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:21.705933 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:21.781927 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:21.782535 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:21.789995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:21.790448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:21.791218 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:21.791654 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:21.818949 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-73070ffa-65a1-4858-8566-fdee3004230c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:21.828370 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-73070ffa-65a1-4858-8566-fdee3004230c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1508 microversion: 2.1 time: 0.141855 Aug 01 14:16:21.829321 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 453/914] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:21 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1508 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:21.943312 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:21.955894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:21.968006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:21.970465 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9a030f1d-318c-4632-94a4-9fcb3559ceb7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.192554 Aug 01 14:16:21.971559 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 462/915] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:21 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:21.991629 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-caab0968-8c48-435f-baaa-5896f356c173 req-054a97c8-aabf-45dd-b39c-621a7a302db8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0c5482-0e86-4a38-8b7e-69b2e4def9e5", "name": "network-vif-deleted", "tag": "0adf5e77-fe49-401a-95b7-2047d19a841b"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:22.001866 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-caab0968-8c48-435f-baaa-5896f356c173 req-054a97c8-aabf-45dd-b39c-621a7a302db8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:22.002781 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-caab0968-8c48-435f-baaa-5896f356c173 req-054a97c8-aabf-45dd-b39c-621a7a302db8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:22.016729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-caab0968-8c48-435f-baaa-5896f356c173 req-054a97c8-aabf-45dd-b39c-621a7a302db8 service nova] Creating event network-vif-deleted:0adf5e77-fe49-401a-95b7-2047d19a841b for instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 on hv-cinder-84713 Aug 01 14:16:22.022469 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-caab0968-8c48-435f-baaa-5896f356c173 req-054a97c8-aabf-45dd-b39c-621a7a302db8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036382 Aug 01 14:16:22.024754 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 454/916] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:22.197721 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b3e2b6d8-319d-4011-8786-4c9ee573656a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:22.198649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b3e2b6d8-319d-4011-8786-4c9ee573656a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:22.215004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b3e2b6d8-319d-4011-8786-4c9ee573656a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:22.215470 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b3e2b6d8-319d-4011-8786-4c9ee573656a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:22.216589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b3e2b6d8-319d-4011-8786-4c9ee573656a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:22.217025 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b3e2b6d8-319d-4011-8786-4c9ee573656a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:22.355953 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b3e2b6d8-319d-4011-8786-4c9ee573656a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:22.364224 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b3e2b6d8-319d-4011-8786-4c9ee573656a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.170444 Aug 01 14:16:22.377539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 463/917] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:22 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:22.853966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8cf4a926-5444-43d8-a433-c3d0d0c2ced7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:22.854957 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8cf4a926-5444-43d8-a433-c3d0d0c2ced7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:22.862108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8cf4a926-5444-43d8-a433-c3d0d0c2ced7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:22.862901 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8cf4a926-5444-43d8-a433-c3d0d0c2ced7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:22.863954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8cf4a926-5444-43d8-a433-c3d0d0c2ced7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:22.865080 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8cf4a926-5444-43d8-a433-c3d0d0c2ced7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:22.968680 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8cf4a926-5444-43d8-a433-c3d0d0c2ced7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:22.977836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8cf4a926-5444-43d8-a433-c3d0d0c2ced7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1508 microversion: 2.1 time: 0.131148 Aug 01 14:16:22.978430 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 455/918] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:22 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1508 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:22.998222 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:22.998936 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:23.005709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:23.006261 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:23.007126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:23.007789 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:23.266450 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:23.281287 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:23.281287 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:23.281287 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8ade7b60-8d88-419a-9130-4cf128f512b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.284690 Aug 01 14:16:23.281780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 464/919] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:22 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:23.390297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4277a12e-f377-447d-adac-735a8f5c3efd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:23.391093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4277a12e-f377-447d-adac-735a8f5c3efd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:23.397252 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4277a12e-f377-447d-adac-735a8f5c3efd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:23.397616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4277a12e-f377-447d-adac-735a8f5c3efd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:23.398391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4277a12e-f377-447d-adac-735a8f5c3efd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:23.398834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4277a12e-f377-447d-adac-735a8f5c3efd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:23.802483 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4277a12e-f377-447d-adac-735a8f5c3efd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:23.815948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4277a12e-f377-447d-adac-735a8f5c3efd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.426576 Aug 01 14:16:23.816765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 456/920] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:23 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:23.998989 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b914edd8-49b5-4254-aefe-e0f934af074d tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:23.999523 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b914edd8-49b5-4254-aefe-e0f934af074d tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:24.005493 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b914edd8-49b5-4254-aefe-e0f934af074d tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:24.005940 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b914edd8-49b5-4254-aefe-e0f934af074d tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:24.006695 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b914edd8-49b5-4254-aefe-e0f934af074d tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:24.007130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b914edd8-49b5-4254-aefe-e0f934af074d tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:24.068998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b914edd8-49b5-4254-aefe-e0f934af074d tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:24.076810 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b914edd8-49b5-4254-aefe-e0f934af074d tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1224 microversion: 2.1 time: 0.081630 Aug 01 14:16:24.078196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 465/921] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:23 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1224 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:24.302495 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:24.303179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:24.310346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:24.310797 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:24.311569 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:24.312058 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:24.452775 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:24.461540 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:24.463090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:24.464274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7dc2e308-ca50-4c46-beef-13c45dfca2e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.165723 Aug 01 14:16:24.464891 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 457/922] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:24 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:24.837307 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-800bf22a-0b43-479a-94fc-54be11e83124 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:24.837935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-800bf22a-0b43-479a-94fc-54be11e83124 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:24.844454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-800bf22a-0b43-479a-94fc-54be11e83124 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:24.844942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-800bf22a-0b43-479a-94fc-54be11e83124 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:24.845708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-800bf22a-0b43-479a-94fc-54be11e83124 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:24.846149 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-800bf22a-0b43-479a-94fc-54be11e83124 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:24.979085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-800bf22a-0b43-479a-94fc-54be11e83124 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:24.987276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-800bf22a-0b43-479a-94fc-54be11e83124 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1367 microversion: 2.1 time: 0.153913 Aug 01 14:16:24.987874 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 466/923] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:24 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:25.099187 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:25.099718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:25.105722 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:25.106678 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:25.107430 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:25.107861 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:25.137726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:25.138174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:25.138617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lazy-loading 'fault' on Instance uuid ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:16:25.179116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:25.187130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-65228656-a2d7-48c2-b720-48b33a3aff38 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1229 microversion: 2.1 time: 0.091883 Aug 01 14:16:25.187695 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 458/924] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:25 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1229 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:25.487487 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:25.488101 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:25.494183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:25.494634 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:25.495396 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:25.495832 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:25.624222 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:25.632239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:25.633794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:25.634895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-25ee31e9-ab0e-4f1d-b3d7-07954da76812 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.151379 Aug 01 14:16:25.635456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 467/925] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:25 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:26.009156 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c8984965-20a3-459c-b147-758ed36f2a75 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:26.009904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c8984965-20a3-459c-b147-758ed36f2a75 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:26.017062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8984965-20a3-459c-b147-758ed36f2a75 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.017513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8984965-20a3-459c-b147-758ed36f2a75 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.018465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8984965-20a3-459c-b147-758ed36f2a75 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.018907 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8984965-20a3-459c-b147-758ed36f2a75 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.021251 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-ebe0d6ef-6e5d-4a2e-87bc-27bc3fd174d4 req-ea954ee1-fadc-4339-9271-f39c7aa67e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900b90f4-dd21-4df9-a880-5760f2c62ae5", "name": "network-vif-plugged", "status": "completed", "tag": "27822eab-07c3-4ba4-b4e4-e82eaa97336f"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:26.041577 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-ebe0d6ef-6e5d-4a2e-87bc-27bc3fd174d4 req-ea954ee1-fadc-4339-9271-f39c7aa67e9f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.042032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-ebe0d6ef-6e5d-4a2e-87bc-27bc3fd174d4 req-ea954ee1-fadc-4339-9271-f39c7aa67e9f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.061729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-ebe0d6ef-6e5d-4a2e-87bc-27bc3fd174d4 req-ea954ee1-fadc-4339-9271-f39c7aa67e9f service nova] Creating event network-vif-plugged:27822eab-07c3-4ba4-b4e4-e82eaa97336f for instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 on hv-cinder-84713 Aug 01 14:16:26.067807 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-ebe0d6ef-6e5d-4a2e-87bc-27bc3fd174d4 req-ea954ee1-fadc-4339-9271-f39c7aa67e9f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050423 Aug 01 14:16:26.068873 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 468/926] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:26.163579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c8984965-20a3-459c-b147-758ed36f2a75 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:26.171845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c8984965-20a3-459c-b147-758ed36f2a75 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1558 microversion: 2.1 time: 0.167200 Aug 01 14:16:26.172413 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 459/927] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:26 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1558 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:26.192309 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-27b8f572-58b4-4101-908c-2b153dec07f1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:26.192939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-27b8f572-58b4-4101-908c-2b153dec07f1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:26.199433 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-27b8f572-58b4-4101-908c-2b153dec07f1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.199940 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-27b8f572-58b4-4101-908c-2b153dec07f1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.200732 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-27b8f572-58b4-4101-908c-2b153dec07f1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.201177 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-27b8f572-58b4-4101-908c-2b153dec07f1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.206886 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:26.207499 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:26.213386 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.213832 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.214597 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.215031 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.247896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.248340 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.248824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lazy-loading 'fault' on Instance uuid ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:16:26.288762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-27b8f572-58b4-4101-908c-2b153dec07f1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100495 Aug 01 14:16:26.289371 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 469/928] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 14:16:26 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:26.293064 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:26.301863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f85ea719-6065-45a0-ada7-5fd3894826ba tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 200 len: 1229 microversion: 2.1 time: 0.098652 Aug 01 14:16:26.302451 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 460/929] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:26 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:26.658034 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:26.658642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:26.664729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.665169 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.665926 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:26.666365 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:26.798410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:26.806932 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:26.808584 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:26.810193 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b5d2c04d-e158-4933-957a-df139558288e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.156035 Aug 01 14:16:26.810774 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 470/930] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:26 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:27.274864 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-96067030-73e4-452d-81a6-2d67f2b9bdbc req-2a52e7e2-2061-4ab1-8fde-1cc7b8d26d1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a6965a-e41a-44e6-8317-3a420f00e98f", "tag": "ebafe7aa-c8e3-4a0e-9296-a84b979fd578"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:27.284951 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-96067030-73e4-452d-81a6-2d67f2b9bdbc req-2a52e7e2-2061-4ab1-8fde-1cc7b8d26d1b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:27.285395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-96067030-73e4-452d-81a6-2d67f2b9bdbc req-2a52e7e2-2061-4ab1-8fde-1cc7b8d26d1b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:27.297130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-96067030-73e4-452d-81a6-2d67f2b9bdbc req-2a52e7e2-2061-4ab1-8fde-1cc7b8d26d1b service nova] Creating event network-changed:ebafe7aa-c8e3-4a0e-9296-a84b979fd578 for instance a0a6965a-e41a-44e6-8317-3a420f00e98f on hv-cinder-84713 Aug 01 14:16:27.301945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-96067030-73e4-452d-81a6-2d67f2b9bdbc req-2a52e7e2-2061-4ab1-8fde-1cc7b8d26d1b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030749 Aug 01 14:16:27.302541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 461/931] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:27.322972 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:27.323846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:27.330596 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:27.331420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:27.332203 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:27.332673 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:27.346582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] HTTP exception thrown: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Request method failure captured: Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 HTTP/1.1 Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi598U0vpbEZe_lzpVi-XbfwElx8PoIWStBmS6FsDic3i5z8sNsAqEXlHh41-hxbJingtd0ApxVmYr4l2FSMqaq-miBtb0IBbuqlF1boy0McMo_8DyjaSBaH1OrESPws99W0Mkgzg3iqaB4rsCoCek6V_KSk9QMQ31OgpZWS8R95UcttE Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:16:27.348226 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7bb93e302f1441fca85409de83230d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}] Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 2eb09df64dd74ddeb9fbbf44ae0a3592 Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:16:27.349762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': 'ec0c5482-0e86-4a38-8b7e-69b2e4def9e5'} Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:27.350656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:16:27.352070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:27.353351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Returning 404 to user: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:27.353351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e5f0e061-8b40-45fe-9505-1e267a826031 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 404 len: 111 microversion: 2.1 time: 0.030525 Aug 01 14:16:27.353888 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 471/932] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:27 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:16:27.455154 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2017267704", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-162466780", "security_groups": [{"name": "tempest-secgroup-smoke-1640434700"}], "block_device_mapping_v2": [{"uuid": "e8e12192-2e60-44e8-937f-0b6a214152f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "867b8e09-a18b-436d-b07f-57394adda503"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:27.573734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] validate_networks() for [('867b8e09-a18b-436d-b07f-57394adda503', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:16:27.833569 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:27.834495 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:27.837617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:27.842431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:27.843088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:27.844138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:27.844605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:28.118309 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:16:28.118728 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:16:28.119195 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:16:28.119593 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:16:28.120002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:16:28.133126 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:28.135273 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:28.136588 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:28.137336 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:28.158286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Getting quotas for project 7bb93e302f1441fca85409de83230d6a. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:16:28.162285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Getting quotas for user 2eb09df64dd74ddeb9fbbf44ae0a3592 and project 7bb93e302f1441fca85409de83230d6a. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:16:28.171441 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:28.172377 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:28.180189 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:28.182352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:28.183021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4f63a903-17c6-42b5-8e61-4892ce2cff5e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1406 microversion: 2.20 time: 0.353441 Aug 01 14:16:28.184523 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 472/933] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:27 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1406 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:16:28.225624 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:16:28.227802 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8e12192-2e60-44e8-937f-0b6a214152f7',volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:16:28.371913 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a2d4d51b-9ba2-49b8-8a70-7dc09e4d671c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.920835 Aug 01 14:16:28.380390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 462/934] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:16:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:16:28.384930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-659cee80-b970-4c36-9229-6200c25b3dc6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:28.385540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-659cee80-b970-4c36-9229-6200c25b3dc6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:28.444364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-659cee80-b970-4c36-9229-6200c25b3dc6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:28.451805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-659cee80-b970-4c36-9229-6200c25b3dc6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1094 microversion: 2.1 time: 0.070595 Aug 01 14:16:28.453825 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 473/935] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:28 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:29.206651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:29.207265 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:29.213674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:29.214126 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:29.214902 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:29.215342 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:29.350689 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:29.358765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:29.360284 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:29.361478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5664fbec-ada4-4cdc-a42d-5d7dba13c02e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1598 microversion: 2.20 time: 0.158810 Aug 01 14:16:29.362052 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 463/936] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:16:29 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:16:29.384036 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5dded243-3ce9-4b67-8795-8f8126718568 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:29.384453 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5dded243-3ce9-4b67-8795-8f8126718568 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:29.396740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5dded243-3ce9-4b67-8795-8f8126718568 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:29.397902 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5dded243-3ce9-4b67-8795-8f8126718568 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:29.398845 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5dded243-3ce9-4b67-8795-8f8126718568 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:29.399447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5dded243-3ce9-4b67-8795-8f8126718568 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:29.487498 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7e85b322-c3cd-4f2c-8e9b-f6321adf07fe tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:29.488253 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7e85b322-c3cd-4f2c-8e9b-f6321adf07fe tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:29.492080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5dded243-3ce9-4b67-8795-8f8126718568 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111781 Aug 01 14:16:29.493216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 474/937] 10.222.0.48 () {60 vars in 1316 bytes} [Mon Aug 1 14:16:29 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:16:29.501806 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e85b322-c3cd-4f2c-8e9b-f6321adf07fe tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:29.502530 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e85b322-c3cd-4f2c-8e9b-f6321adf07fe tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:29.503721 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e85b322-c3cd-4f2c-8e9b-f6321adf07fe tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:29.504397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e85b322-c3cd-4f2c-8e9b-f6321adf07fe tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:29.636785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7e85b322-c3cd-4f2c-8e9b-f6321adf07fe tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:29.649008 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7e85b322-c3cd-4f2c-8e9b-f6321adf07fe tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1192 microversion: 2.1 time: 0.178690 Aug 01 14:16:29.649896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 464/938] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:29 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1192 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:30.678654 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8de3f758-127f-457a-bba1-26cf21f91440 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:30.679594 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8de3f758-127f-457a-bba1-26cf21f91440 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:30.688447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8de3f758-127f-457a-bba1-26cf21f91440 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:30.689048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8de3f758-127f-457a-bba1-26cf21f91440 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:30.690338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8de3f758-127f-457a-bba1-26cf21f91440 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:30.690989 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8de3f758-127f-457a-bba1-26cf21f91440 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:30.756202 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8de3f758-127f-457a-bba1-26cf21f91440 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:30.767740 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8de3f758-127f-457a-bba1-26cf21f91440 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1198 microversion: 2.1 time: 0.093735 Aug 01 14:16:30.768743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 475/939] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:30 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1198 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:31.390270 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ba779ee7-4c9d-406b-8712-d0ef27dcc4b5 req-43750717-6cd2-4a17-b37c-18310774c6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900b90f4-dd21-4df9-a880-5760f2c62ae5", "tag": "27822eab-07c3-4ba4-b4e4-e82eaa97336f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:31.402071 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ba779ee7-4c9d-406b-8712-d0ef27dcc4b5 req-43750717-6cd2-4a17-b37c-18310774c6d3 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:31.403544 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ba779ee7-4c9d-406b-8712-d0ef27dcc4b5 req-43750717-6cd2-4a17-b37c-18310774c6d3 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:31.426126 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ba779ee7-4c9d-406b-8712-d0ef27dcc4b5 req-43750717-6cd2-4a17-b37c-18310774c6d3 service nova] Creating event network-changed:27822eab-07c3-4ba4-b4e4-e82eaa97336f for instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 on hv-cinder-84713 Aug 01 14:16:31.431698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ba779ee7-4c9d-406b-8712-d0ef27dcc4b5 req-43750717-6cd2-4a17-b37c-18310774c6d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046059 Aug 01 14:16:31.432861 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 465/940] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:31.804617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c70d15b0-c104-4448-9b3b-a8f68ca53626 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:31.809827 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c70d15b0-c104-4448-9b3b-a8f68ca53626 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:31.821334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c70d15b0-c104-4448-9b3b-a8f68ca53626 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:31.822517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c70d15b0-c104-4448-9b3b-a8f68ca53626 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:31.824345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c70d15b0-c104-4448-9b3b-a8f68ca53626 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:31.826334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c70d15b0-c104-4448-9b3b-a8f68ca53626 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:32.014068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c70d15b0-c104-4448-9b3b-a8f68ca53626 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:32.022376 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c70d15b0-c104-4448-9b3b-a8f68ca53626 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.224406 Aug 01 14:16:32.023225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 476/941] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:31 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:33.054295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2998ccda-b3c5-47e5-b2ea-67ed4447a4ad tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:33.054911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2998ccda-b3c5-47e5-b2ea-67ed4447a4ad tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:33.062131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2998ccda-b3c5-47e5-b2ea-67ed4447a4ad tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:33.062584 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2998ccda-b3c5-47e5-b2ea-67ed4447a4ad tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:33.063358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2998ccda-b3c5-47e5-b2ea-67ed4447a4ad tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:33.063796 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2998ccda-b3c5-47e5-b2ea-67ed4447a4ad tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:33.197567 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2998ccda-b3c5-47e5-b2ea-67ed4447a4ad tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:33.205981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2998ccda-b3c5-47e5-b2ea-67ed4447a4ad tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.156700 Aug 01 14:16:33.206565 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 466/942] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:33 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:33.484888 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-f39c712f-644c-4d76-9d0d-92cf3f38a126 req-2b68d29c-e2cc-4412-836c-8bb407fe64ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efc1e4-f466-4454-8f66-234276687e49", "tag": "ac84e85d-c243-4cb3-8ab7-11ae2fb7285b"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:33.495006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-f39c712f-644c-4d76-9d0d-92cf3f38a126 req-2b68d29c-e2cc-4412-836c-8bb407fe64ca service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:33.495456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-f39c712f-644c-4d76-9d0d-92cf3f38a126 req-2b68d29c-e2cc-4412-836c-8bb407fe64ca service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:33.506493 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-f39c712f-644c-4d76-9d0d-92cf3f38a126 req-2b68d29c-e2cc-4412-836c-8bb407fe64ca service nova] Creating event network-changed:ac84e85d-c243-4cb3-8ab7-11ae2fb7285b for instance 77efc1e4-f466-4454-8f66-234276687e49 on hv-cinder-84713 Aug 01 14:16:33.511428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-f39c712f-644c-4d76-9d0d-92cf3f38a126 req-2b68d29c-e2cc-4412-836c-8bb407fe64ca service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030198 Aug 01 14:16:33.512511 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 477/943] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:34.227304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c631ec0a-27bc-43fe-a12b-85014b32fa5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:34.228049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c631ec0a-27bc-43fe-a12b-85014b32fa5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:34.235370 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c631ec0a-27bc-43fe-a12b-85014b32fa5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:34.235825 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c631ec0a-27bc-43fe-a12b-85014b32fa5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:34.236639 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c631ec0a-27bc-43fe-a12b-85014b32fa5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:34.237081 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c631ec0a-27bc-43fe-a12b-85014b32fa5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:34.431555 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c631ec0a-27bc-43fe-a12b-85014b32fa5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:34.440598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c631ec0a-27bc-43fe-a12b-85014b32fa5f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.217045 Aug 01 14:16:34.446271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 467/944] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:34 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:35.461916 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-68c8b6ae-ebe2-4eb7-a490-1ad01f355077 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:35.462967 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-68c8b6ae-ebe2-4eb7-a490-1ad01f355077 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:35.479316 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-68c8b6ae-ebe2-4eb7-a490-1ad01f355077 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:35.479940 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-68c8b6ae-ebe2-4eb7-a490-1ad01f355077 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:35.481274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-68c8b6ae-ebe2-4eb7-a490-1ad01f355077 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:35.482000 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-68c8b6ae-ebe2-4eb7-a490-1ad01f355077 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:35.558476 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-93e5bec1-9502-4023-aa4c-99f6fc4f7b73 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:35.559363 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-93e5bec1-9502-4023-aa4c-99f6fc4f7b73 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:35.566544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93e5bec1-9502-4023-aa4c-99f6fc4f7b73 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:35.567009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93e5bec1-9502-4023-aa4c-99f6fc4f7b73 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:35.567789 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93e5bec1-9502-4023-aa4c-99f6fc4f7b73 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:35.568236 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93e5bec1-9502-4023-aa4c-99f6fc4f7b73 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:35.677745 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-93e5bec1-9502-4023-aa4c-99f6fc4f7b73 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lazy-loading 'services' on Instance uuid 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:16:35.758455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-93e5bec1-9502-4023-aa4c-99f6fc4f7b73 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/os-volume_attachments/214382c8-e3cc-4f81-ad08-64dba7a789db" status: 202 len: 0 microversion: 2.1 time: 0.403075 Aug 01 14:16:35.759047 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 478/945] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:16:35 2022] DELETE /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/os-volume_attachments/214382c8-e3cc-4f81-ad08-64dba7a789db => generated 0 bytes in 405 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:16:35.819588 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-68c8b6ae-ebe2-4eb7-a490-1ad01f355077 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:35.830037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-68c8b6ae-ebe2-4eb7-a490-1ad01f355077 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.372289 Aug 01 14:16:35.830924 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 468/946] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:35 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:36.858523 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2a3417cf-da1f-480a-9fa3-93d2d2dadcd7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:36.859701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2a3417cf-da1f-480a-9fa3-93d2d2dadcd7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:36.866853 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2a3417cf-da1f-480a-9fa3-93d2d2dadcd7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:36.867379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2a3417cf-da1f-480a-9fa3-93d2d2dadcd7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:36.868070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2a3417cf-da1f-480a-9fa3-93d2d2dadcd7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:36.868527 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2a3417cf-da1f-480a-9fa3-93d2d2dadcd7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:36.934988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5cca8033-f5f1-49d6-9f92-a94ff0c137da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:36.943354 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cca8033-f5f1-49d6-9f92-a94ff0c137da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:36.943918 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5cca8033-f5f1-49d6-9f92-a94ff0c137da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:36.970046 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5cca8033-f5f1-49d6-9f92-a94ff0c137da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Going to try to stop instance {{(pid=117859) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 01 14:16:37.015991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2a3417cf-da1f-480a-9fa3-93d2d2dadcd7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:37.016923 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5cca8033-f5f1-49d6-9f92-a94ff0c137da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/action" status: 202 len: 0 microversion: 2.1 time: 0.086080 Aug 01 14:16:37.017633 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 469/947] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:16:36 2022] POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:16:37.024832 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2a3417cf-da1f-480a-9fa3-93d2d2dadcd7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.175177 Aug 01 14:16:37.025691 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 479/948] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:36 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:37.030774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d77feedd-f54a-44d1-8d62-3e77bfa10286 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:37.033075 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d77feedd-f54a-44d1-8d62-3e77bfa10286 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:37.044664 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d77feedd-f54a-44d1-8d62-3e77bfa10286 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:37.045452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d77feedd-f54a-44d1-8d62-3e77bfa10286 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:37.046916 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d77feedd-f54a-44d1-8d62-3e77bfa10286 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:37.047702 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d77feedd-f54a-44d1-8d62-3e77bfa10286 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:37.192535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d77feedd-f54a-44d1-8d62-3e77bfa10286 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:37.196390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:37.202510 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d77feedd-f54a-44d1-8d62-3e77bfa10286 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.179322 Aug 01 14:16:37.203094 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 470/949] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:37 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:38.061818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0edcee51-e9c9-4fe4-a262-79841fcd96d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:38.062413 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0edcee51-e9c9-4fe4-a262-79841fcd96d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:38.069444 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0edcee51-e9c9-4fe4-a262-79841fcd96d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:38.069808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0edcee51-e9c9-4fe4-a262-79841fcd96d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:38.070577 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0edcee51-e9c9-4fe4-a262-79841fcd96d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:38.071004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0edcee51-e9c9-4fe4-a262-79841fcd96d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:38.206125 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0edcee51-e9c9-4fe4-a262-79841fcd96d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:38.213726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0edcee51-e9c9-4fe4-a262-79841fcd96d7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.156460 Aug 01 14:16:38.214820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 480/950] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:38 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:38.223651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e1a8a01e-b695-4622-be6e-169857d98dc1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:38.224382 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e1a8a01e-b695-4622-be6e-169857d98dc1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:38.226785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:38.227507 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:38.235649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1a8a01e-b695-4622-be6e-169857d98dc1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:38.236101 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1a8a01e-b695-4622-be6e-169857d98dc1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:38.236912 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1a8a01e-b695-4622-be6e-169857d98dc1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:38.237359 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1a8a01e-b695-4622-be6e-169857d98dc1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:38.366679 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e1a8a01e-b695-4622-be6e-169857d98dc1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:38.375471 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e1a8a01e-b695-4622-be6e-169857d98dc1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.156201 Aug 01 14:16:38.376042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 471/951] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:38 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:39.236679 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:39.288723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-30da36af-0632-40ae-9a01-62983734053f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:39.289336 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-30da36af-0632-40ae-9a01-62983734053f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:39.295854 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30da36af-0632-40ae-9a01-62983734053f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:39.296275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30da36af-0632-40ae-9a01-62983734053f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:39.297069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30da36af-0632-40ae-9a01-62983734053f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:39.297503 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30da36af-0632-40ae-9a01-62983734053f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:39.315684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:39.396761 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-66aec573-8ee2-40ee-b42f-5bad74be62d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:39.397384 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-66aec573-8ee2-40ee-b42f-5bad74be62d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:39.405604 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-66aec573-8ee2-40ee-b42f-5bad74be62d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:39.406496 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-66aec573-8ee2-40ee-b42f-5bad74be62d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:39.407619 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-66aec573-8ee2-40ee-b42f-5bad74be62d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:39.408714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-66aec573-8ee2-40ee-b42f-5bad74be62d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:39.451901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-30da36af-0632-40ae-9a01-62983734053f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:39.459569 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-30da36af-0632-40ae-9a01-62983734053f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.227605 Aug 01 14:16:39.460142 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 481/952] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:39 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:39.565073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-66aec573-8ee2-40ee-b42f-5bad74be62d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:39.572995 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-66aec573-8ee2-40ee-b42f-5bad74be62d3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.179786 Aug 01 14:16:39.573579 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 472/953] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:39 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:40.480978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6e010bf1-8883-4d9e-a45c-3a11561bb862 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:40.481636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6e010bf1-8883-4d9e-a45c-3a11561bb862 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:40.488071 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6e010bf1-8883-4d9e-a45c-3a11561bb862 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:40.488556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6e010bf1-8883-4d9e-a45c-3a11561bb862 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:40.489329 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6e010bf1-8883-4d9e-a45c-3a11561bb862 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:40.489768 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6e010bf1-8883-4d9e-a45c-3a11561bb862 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:40.595901 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ddcf8184-3b91-409e-8414-6ba23718aa2f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:40.596572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ddcf8184-3b91-409e-8414-6ba23718aa2f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:40.602820 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ddcf8184-3b91-409e-8414-6ba23718aa2f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:40.603274 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ddcf8184-3b91-409e-8414-6ba23718aa2f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:40.604062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ddcf8184-3b91-409e-8414-6ba23718aa2f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:40.604533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ddcf8184-3b91-409e-8414-6ba23718aa2f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:40.625625 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6e010bf1-8883-4d9e-a45c-3a11561bb862 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:40.633780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6e010bf1-8883-4d9e-a45c-3a11561bb862 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.157431 Aug 01 14:16:40.634355 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 482/954] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:40 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:40.739849 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ddcf8184-3b91-409e-8414-6ba23718aa2f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:40.747390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ddcf8184-3b91-409e-8414-6ba23718aa2f tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.155475 Aug 01 14:16:40.747947 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 473/955] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:40 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:41.662669 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-622c1bcb-c4fd-4fe7-b55f-ecd85d37ec1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:41.663291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-622c1bcb-c4fd-4fe7-b55f-ecd85d37ec1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:41.670351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-622c1bcb-c4fd-4fe7-b55f-ecd85d37ec1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:41.670809 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-622c1bcb-c4fd-4fe7-b55f-ecd85d37ec1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:41.671575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-622c1bcb-c4fd-4fe7-b55f-ecd85d37ec1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:41.672015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-622c1bcb-c4fd-4fe7-b55f-ecd85d37ec1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:41.768402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-266b5c73-97c6-4ea3-be54-48d37eb6a26e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:41.769045 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-266b5c73-97c6-4ea3-be54-48d37eb6a26e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:41.776144 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-266b5c73-97c6-4ea3-be54-48d37eb6a26e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:41.776626 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-266b5c73-97c6-4ea3-be54-48d37eb6a26e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:41.777410 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-266b5c73-97c6-4ea3-be54-48d37eb6a26e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:41.777840 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-266b5c73-97c6-4ea3-be54-48d37eb6a26e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:41.824978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-622c1bcb-c4fd-4fe7-b55f-ecd85d37ec1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:41.832725 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-622c1bcb-c4fd-4fe7-b55f-ecd85d37ec1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.173913 Aug 01 14:16:41.833301 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 483/956] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:41 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:41.914230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-266b5c73-97c6-4ea3-be54-48d37eb6a26e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:41.922290 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-266b5c73-97c6-4ea3-be54-48d37eb6a26e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.157771 Aug 01 14:16:41.922855 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 474/957] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:41 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:42.853816 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e442427e-c2e3-48bd-8643-b5f0df0bdd80 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:42.854521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e442427e-c2e3-48bd-8643-b5f0df0bdd80 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:42.861446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e442427e-c2e3-48bd-8643-b5f0df0bdd80 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:42.861890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e442427e-c2e3-48bd-8643-b5f0df0bdd80 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:42.862651 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e442427e-c2e3-48bd-8643-b5f0df0bdd80 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:42.863085 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e442427e-c2e3-48bd-8643-b5f0df0bdd80 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:42.948084 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0f97b2e4-ab66-4eb2-a96b-05fd03e9beef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:42.949666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0f97b2e4-ab66-4eb2-a96b-05fd03e9beef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:42.959398 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f97b2e4-ab66-4eb2-a96b-05fd03e9beef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:42.959839 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f97b2e4-ab66-4eb2-a96b-05fd03e9beef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:42.960641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f97b2e4-ab66-4eb2-a96b-05fd03e9beef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:42.961072 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f97b2e4-ab66-4eb2-a96b-05fd03e9beef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:43.004697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e442427e-c2e3-48bd-8643-b5f0df0bdd80 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:43.012798 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e442427e-c2e3-48bd-8643-b5f0df0bdd80 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.162739 Aug 01 14:16:43.013464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 484/958] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:42 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:43.095085 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f97b2e4-ab66-4eb2-a96b-05fd03e9beef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:43.102605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0f97b2e4-ab66-4eb2-a96b-05fd03e9beef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.161831 Aug 01 14:16:43.103164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 475/959] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:42 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:44.045180 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b03822d5-9a24-4e09-a92b-d279d6b91c61 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:44.045889 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b03822d5-9a24-4e09-a92b-d279d6b91c61 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:44.052397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b03822d5-9a24-4e09-a92b-d279d6b91c61 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:44.052978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b03822d5-9a24-4e09-a92b-d279d6b91c61 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:44.053866 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b03822d5-9a24-4e09-a92b-d279d6b91c61 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:44.054390 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b03822d5-9a24-4e09-a92b-d279d6b91c61 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:44.124144 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ca253b4f-f12b-4057-a43b-b166bbbaa2d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:44.125073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ca253b4f-f12b-4057-a43b-b166bbbaa2d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:44.131120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca253b4f-f12b-4057-a43b-b166bbbaa2d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:44.131571 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca253b4f-f12b-4057-a43b-b166bbbaa2d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:44.132586 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca253b4f-f12b-4057-a43b-b166bbbaa2d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:44.133145 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ca253b4f-f12b-4057-a43b-b166bbbaa2d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:44.218344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b03822d5-9a24-4e09-a92b-d279d6b91c61 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:44.227318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b03822d5-9a24-4e09-a92b-d279d6b91c61 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.186157 Aug 01 14:16:44.228205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 485/960] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:44 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:44.233750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-da35de9a-54a9-4164-a144-83bb2719dcc2 req-50b06fd4-94a7-4714-a823-1ce887b0c4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77efc1e4-f466-4454-8f66-234276687e49", "name": "network-vif-plugged", "status": "completed", "tag": "ac84e85d-c243-4cb3-8ab7-11ae2fb7285b"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:44.243291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-da35de9a-54a9-4164-a144-83bb2719dcc2 req-50b06fd4-94a7-4714-a823-1ce887b0c4f4 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:44.243878 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-da35de9a-54a9-4164-a144-83bb2719dcc2 req-50b06fd4-94a7-4714-a823-1ce887b0c4f4 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:44.257391 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-da35de9a-54a9-4164-a144-83bb2719dcc2 req-50b06fd4-94a7-4714-a823-1ce887b0c4f4 service nova] Creating event network-vif-plugged:ac84e85d-c243-4cb3-8ab7-11ae2fb7285b for instance 77efc1e4-f466-4454-8f66-234276687e49 on hv-cinder-84713 Aug 01 14:16:44.263166 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-da35de9a-54a9-4164-a144-83bb2719dcc2 req-50b06fd4-94a7-4714-a823-1ce887b0c4f4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033102 Aug 01 14:16:44.263907 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 486/961] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:44.291776 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ca253b4f-f12b-4057-a43b-b166bbbaa2d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:44.299238 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ca253b4f-f12b-4057-a43b-b166bbbaa2d0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.179776 Aug 01 14:16:44.299797 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 476/962] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:44 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:45.257648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f0c21e6a-b03a-481e-8db9-363fcc0a8ba3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:45.258341 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f0c21e6a-b03a-481e-8db9-363fcc0a8ba3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:45.265223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0c21e6a-b03a-481e-8db9-363fcc0a8ba3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:45.265663 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0c21e6a-b03a-481e-8db9-363fcc0a8ba3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:45.266414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0c21e6a-b03a-481e-8db9-363fcc0a8ba3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:45.266846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0c21e6a-b03a-481e-8db9-363fcc0a8ba3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:45.321879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cf9a11ff-9791-4ee5-80a4-fa143902e2e1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:45.322737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cf9a11ff-9791-4ee5-80a4-fa143902e2e1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:45.329893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf9a11ff-9791-4ee5-80a4-fa143902e2e1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:45.330359 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf9a11ff-9791-4ee5-80a4-fa143902e2e1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:45.331100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf9a11ff-9791-4ee5-80a4-fa143902e2e1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:45.331535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf9a11ff-9791-4ee5-80a4-fa143902e2e1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:45.408830 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f0c21e6a-b03a-481e-8db9-363fcc0a8ba3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:45.416621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f0c21e6a-b03a-481e-8db9-363fcc0a8ba3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1266 microversion: 2.1 time: 0.163058 Aug 01 14:16:45.417342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 487/963] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:45 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:45.475760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cf9a11ff-9791-4ee5-80a4-fa143902e2e1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:45.485292 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cf9a11ff-9791-4ee5-80a4-fa143902e2e1 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.167288 Aug 01 14:16:45.485862 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 477/964] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:45 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:46.443137 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4d1a4478-08c8-4385-9684-49f2b670c02c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:46.443900 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4d1a4478-08c8-4385-9684-49f2b670c02c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:46.451302 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d1a4478-08c8-4385-9684-49f2b670c02c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.451795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d1a4478-08c8-4385-9684-49f2b670c02c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.452793 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d1a4478-08c8-4385-9684-49f2b670c02c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.453290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4d1a4478-08c8-4385-9684-49f2b670c02c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.508242 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3814b6b0-3afc-47e7-85d9-08aecbd510d4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:46.509901 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3814b6b0-3afc-47e7-85d9-08aecbd510d4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:46.521250 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3814b6b0-3afc-47e7-85d9-08aecbd510d4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.521871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3814b6b0-3afc-47e7-85d9-08aecbd510d4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.522780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3814b6b0-3afc-47e7-85d9-08aecbd510d4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.523341 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3814b6b0-3afc-47e7-85d9-08aecbd510d4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.603737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4d1a4478-08c8-4385-9684-49f2b670c02c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:46.618761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4d1a4478-08c8-4385-9684-49f2b670c02c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1452 microversion: 2.1 time: 0.179593 Aug 01 14:16:46.619520 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 488/965] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:46 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1452 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:46.626804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e2f372cf-5c49-4245-b354-7c83977ace6a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:46.627077 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e2f372cf-5c49-4245-b354-7c83977ace6a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:46.636621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e2f372cf-5c49-4245-b354-7c83977ace6a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.637198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e2f372cf-5c49-4245-b354-7c83977ace6a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.638216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e2f372cf-5c49-4245-b354-7c83977ace6a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.638760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e2f372cf-5c49-4245-b354-7c83977ace6a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.702872 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3814b6b0-3afc-47e7-85d9-08aecbd510d4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:46.711446 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3814b6b0-3afc-47e7-85d9-08aecbd510d4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.208638 Aug 01 14:16:46.712174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 478/966] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:46 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:46.724193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9e6c2164-1517-4c33-a002-f5f8b1ca4509 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:46.724930 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9e6c2164-1517-4c33-a002-f5f8b1ca4509 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:46.731509 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e6c2164-1517-4c33-a002-f5f8b1ca4509 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.732010 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e6c2164-1517-4c33-a002-f5f8b1ca4509 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.732815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e6c2164-1517-4c33-a002-f5f8b1ca4509 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.733253 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e6c2164-1517-4c33-a002-f5f8b1ca4509 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.733678 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-e2f372cf-5c49-4245-b354-7c83977ace6a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lazy-loading 'services' on Instance uuid c9bc4793-88a4-4bc0-a99d-c5161e63842b {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:16:46.815533 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e2f372cf-5c49-4245-b354-7c83977ace6a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments/7522d5c9-586a-4490-8177-47524d0ea5ba" status: 202 len: 0 microversion: 2.1 time: 0.193759 Aug 01 14:16:46.816409 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 489/967] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:16:46 2022] DELETE /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments/7522d5c9-586a-4490-8177-47524d0ea5ba => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:16:46.829753 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-019f3513-375a-4119-bfb4-86599e0f185c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:46.832183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-019f3513-375a-4119-bfb4-86599e0f185c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:46.842405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-019f3513-375a-4119-bfb4-86599e0f185c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.842892 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-019f3513-375a-4119-bfb4-86599e0f185c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.843671 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-019f3513-375a-4119-bfb4-86599e0f185c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:46.844099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-019f3513-375a-4119-bfb4-86599e0f185c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:46.878096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-019f3513-375a-4119-bfb4-86599e0f185c tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056642 Aug 01 14:16:46.879342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 490/968] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:16:46 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:46.889199 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9e6c2164-1517-4c33-a002-f5f8b1ca4509 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:46.897965 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9e6c2164-1517-4c33-a002-f5f8b1ca4509 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1452 microversion: 2.1 time: 0.184386 Aug 01 14:16:46.898857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 479/969] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:46 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1452 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:47.747933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5ca479b4-dff8-44ca-907f-a55ecca4f44a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:47.749265 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5ca479b4-dff8-44ca-907f-a55ecca4f44a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:47.760942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5ca479b4-dff8-44ca-907f-a55ecca4f44a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:47.761755 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5ca479b4-dff8-44ca-907f-a55ecca4f44a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:47.763124 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5ca479b4-dff8-44ca-907f-a55ecca4f44a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:47.763900 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5ca479b4-dff8-44ca-907f-a55ecca4f44a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:47.894717 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-069f611f-b286-44a3-92fa-64976af5ed0a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:47.899228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-069f611f-b286-44a3-92fa-64976af5ed0a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:47.912129 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-069f611f-b286-44a3-92fa-64976af5ed0a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:47.913362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-069f611f-b286-44a3-92fa-64976af5ed0a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:47.914934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-069f611f-b286-44a3-92fa-64976af5ed0a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:47.915954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-069f611f-b286-44a3-92fa-64976af5ed0a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:47.938416 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5ca479b4-dff8-44ca-907f-a55ecca4f44a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:47.946794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5ca479b4-dff8-44ca-907f-a55ecca4f44a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.203479 Aug 01 14:16:47.960907 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 491/970] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:47 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:47.963900 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-069f611f-b286-44a3-92fa-64976af5ed0a tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075828 Aug 01 14:16:47.964507 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 480/971] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:16:47 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:16:48.567828 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-9b376d3b-4172-4f1b-a993-edc430122765 req-376c78d1-5f16-4721-b30e-8311437dd48b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efc1e4-f466-4454-8f66-234276687e49", "tag": "ac84e85d-c243-4cb3-8ab7-11ae2fb7285b"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:48.578530 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-9b376d3b-4172-4f1b-a993-edc430122765 req-376c78d1-5f16-4721-b30e-8311437dd48b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:48.578966 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-9b376d3b-4172-4f1b-a993-edc430122765 req-376c78d1-5f16-4721-b30e-8311437dd48b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:48.590276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-9b376d3b-4172-4f1b-a993-edc430122765 req-376c78d1-5f16-4721-b30e-8311437dd48b service nova] Creating event network-changed:ac84e85d-c243-4cb3-8ab7-11ae2fb7285b for instance 77efc1e4-f466-4454-8f66-234276687e49 on hv-cinder-84713 Aug 01 14:16:48.595308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-9b376d3b-4172-4f1b-a993-edc430122765 req-376c78d1-5f16-4721-b30e-8311437dd48b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031441 Aug 01 14:16:48.596294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 492/972] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:48.969333 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-65747535-0ca0-46db-9015-db78c7e3285a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:48.970117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-65747535-0ca0-46db-9015-db78c7e3285a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:48.976967 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65747535-0ca0-46db-9015-db78c7e3285a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:48.977654 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65747535-0ca0-46db-9015-db78c7e3285a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:48.978600 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65747535-0ca0-46db-9015-db78c7e3285a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:48.979746 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65747535-0ca0-46db-9015-db78c7e3285a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:48.987783 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2a99fc32-c182-43af-8293-461851366268 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:48.992620 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2a99fc32-c182-43af-8293-461851366268 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:49.008297 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2a99fc32-c182-43af-8293-461851366268 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.009468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2a99fc32-c182-43af-8293-461851366268 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.011087 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2a99fc32-c182-43af-8293-461851366268 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.012087 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2a99fc32-c182-43af-8293-461851366268 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.062601 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2a99fc32-c182-43af-8293-461851366268 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086530 Aug 01 14:16:49.068256 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 493/973] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:16:48 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:16:49.142054 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9cdf5b64-5886-46d9-b200-2faeadabede6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:49.142622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9cdf5b64-5886-46d9-b200-2faeadabede6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:49.148667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9cdf5b64-5886-46d9-b200-2faeadabede6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.149112 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9cdf5b64-5886-46d9-b200-2faeadabede6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.149878 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9cdf5b64-5886-46d9-b200-2faeadabede6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.150308 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9cdf5b64-5886-46d9-b200-2faeadabede6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.183099 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9cdf5b64-5886-46d9-b200-2faeadabede6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:16:49.272349 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9cdf5b64-5886-46d9-b200-2faeadabede6 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 204 len: 0 microversion: 2.1 time: 0.134559 Aug 01 14:16:49.273622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 494/974] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:16:49 2022] DELETE /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:16:49.287161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f0ab3689-04b3-4b27-afad-f3c068f17598 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:49.288032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f0ab3689-04b3-4b27-afad-f3c068f17598 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:49.297361 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0ab3689-04b3-4b27-afad-f3c068f17598 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.298003 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0ab3689-04b3-4b27-afad-f3c068f17598 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.298788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0ab3689-04b3-4b27-afad-f3c068f17598 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:49.299543 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f0ab3689-04b3-4b27-afad-f3c068f17598 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:49.347805 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-65747535-0ca0-46db-9015-db78c7e3285a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:49.360997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-65747535-0ca0-46db-9015-db78c7e3285a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.395382 Aug 01 14:16:49.372508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 481/975] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:48 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:49.477131 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f0ab3689-04b3-4b27-afad-f3c068f17598 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:49.485844 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f0ab3689-04b3-4b27-afad-f3c068f17598 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1691 microversion: 2.1 time: 0.205446 Aug 01 14:16:49.486508 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 495/976] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:49 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:50.390029 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e52beede-6901-4528-9ea4-35f9792ce40d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:50.390641 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e52beede-6901-4528-9ea4-35f9792ce40d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:50.398090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e52beede-6901-4528-9ea4-35f9792ce40d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:50.398537 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e52beede-6901-4528-9ea4-35f9792ce40d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:50.399321 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e52beede-6901-4528-9ea4-35f9792ce40d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:50.399761 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e52beede-6901-4528-9ea4-35f9792ce40d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:50.517202 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7f4dcd50-25de-4deb-8679-da787acf9507 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:50.517976 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7f4dcd50-25de-4deb-8679-da787acf9507 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:50.524822 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f4dcd50-25de-4deb-8679-da787acf9507 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:50.525299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f4dcd50-25de-4deb-8679-da787acf9507 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:50.526708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f4dcd50-25de-4deb-8679-da787acf9507 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:50.527156 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7f4dcd50-25de-4deb-8679-da787acf9507 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:50.538424 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e52beede-6901-4528-9ea4-35f9792ce40d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:50.548979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e52beede-6901-4528-9ea4-35f9792ce40d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.162841 Aug 01 14:16:50.549561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 482/977] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:50 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:50.659652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7f4dcd50-25de-4deb-8679-da787acf9507 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:50.667258 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7f4dcd50-25de-4deb-8679-da787acf9507 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1691 microversion: 2.1 time: 0.154808 Aug 01 14:16:50.667829 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 496/978] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:50 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:51.570977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7ca9d79f-cd30-490c-8479-40dc232668da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:51.571635 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7ca9d79f-cd30-490c-8479-40dc232668da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:51.579535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ca9d79f-cd30-490c-8479-40dc232668da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:51.579970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ca9d79f-cd30-490c-8479-40dc232668da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:51.580774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ca9d79f-cd30-490c-8479-40dc232668da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:51.581206 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ca9d79f-cd30-490c-8479-40dc232668da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:51.687664 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-806859fc-1227-4f35-9192-6e27f806b0a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:51.688289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-806859fc-1227-4f35-9192-6e27f806b0a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:51.695167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-806859fc-1227-4f35-9192-6e27f806b0a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:51.695619 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-806859fc-1227-4f35-9192-6e27f806b0a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:51.696407 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-806859fc-1227-4f35-9192-6e27f806b0a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:51.696891 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-806859fc-1227-4f35-9192-6e27f806b0a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:51.702120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:51.726554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7ca9d79f-cd30-490c-8479-40dc232668da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:51.734284 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7ca9d79f-cd30-490c-8479-40dc232668da tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.167228 Aug 01 14:16:51.734870 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 483/979] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:51 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:51.847978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-806859fc-1227-4f35-9192-6e27f806b0a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:51.857325 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-806859fc-1227-4f35-9192-6e27f806b0a2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1691 microversion: 2.1 time: 0.173497 Aug 01 14:16:51.857923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 497/980] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:51 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1691 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:52.757292 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bce95846-9bb1-4131-aac3-99b6ae186ade tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:52.757908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bce95846-9bb1-4131-aac3-99b6ae186ade tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:52.765169 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bce95846-9bb1-4131-aac3-99b6ae186ade tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:52.765620 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bce95846-9bb1-4131-aac3-99b6ae186ade tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:52.766400 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bce95846-9bb1-4131-aac3-99b6ae186ade tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:52.766843 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bce95846-9bb1-4131-aac3-99b6ae186ade tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:52.879200 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-73fe48dc-aefd-41d8-a768-12dc1f05b186 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:52.880212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-73fe48dc-aefd-41d8-a768-12dc1f05b186 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:52.887677 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73fe48dc-aefd-41d8-a768-12dc1f05b186 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:52.888228 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73fe48dc-aefd-41d8-a768-12dc1f05b186 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:52.889216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73fe48dc-aefd-41d8-a768-12dc1f05b186 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:52.889835 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73fe48dc-aefd-41d8-a768-12dc1f05b186 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:52.903194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bce95846-9bb1-4131-aac3-99b6ae186ade tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:52.911838 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bce95846-9bb1-4131-aac3-99b6ae186ade tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1677 microversion: 2.1 time: 0.158456 Aug 01 14:16:52.912416 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 484/981] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:52 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:53.021453 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-73fe48dc-aefd-41d8-a768-12dc1f05b186 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:53.029796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-73fe48dc-aefd-41d8-a768-12dc1f05b186 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1691 microversion: 2.1 time: 0.154687 Aug 01 14:16:53.030400 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 498/982] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:52 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:53.937215 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f8efd9d4-263c-4489-a961-eb0d619d1b15 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:53.937970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f8efd9d4-263c-4489-a961-eb0d619d1b15 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:53.946173 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8efd9d4-263c-4489-a961-eb0d619d1b15 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:53.946633 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8efd9d4-263c-4489-a961-eb0d619d1b15 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:53.948319 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8efd9d4-263c-4489-a961-eb0d619d1b15 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:53.948798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8efd9d4-263c-4489-a961-eb0d619d1b15 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.051799 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-da50e06b-7f36-468c-b563-b067c4ddeec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:54.052617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-da50e06b-7f36-468c-b563-b067c4ddeec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:54.064005 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-da50e06b-7f36-468c-b563-b067c4ddeec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:54.064463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-da50e06b-7f36-468c-b563-b067c4ddeec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.065302 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-da50e06b-7f36-468c-b563-b067c4ddeec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:54.065879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-da50e06b-7f36-468c-b563-b067c4ddeec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.161069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f8efd9d4-263c-4489-a961-eb0d619d1b15 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:54.177857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f8efd9d4-263c-4489-a961-eb0d619d1b15 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1654 microversion: 2.1 time: 0.247697 Aug 01 14:16:54.178912 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 485/983] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:53 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1654 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:54.211126 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-df2cea53-c49d-41dc-94a2-d30290b17378 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:54.222213 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df2cea53-c49d-41dc-94a2-d30290b17378 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:54.222922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df2cea53-c49d-41dc-94a2-d30290b17378 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.231148 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-da50e06b-7f36-468c-b563-b067c4ddeec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:54.250766 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-df2cea53-c49d-41dc-94a2-d30290b17378 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Going to try to start instance {{(pid=117859) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 01 14:16:54.252341 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-da50e06b-7f36-468c-b563-b067c4ddeec7 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1691 microversion: 2.1 time: 0.204224 Aug 01 14:16:54.253624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 499/984] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:54 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1691 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:54.285275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:54.312525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-df2cea53-c49d-41dc-94a2-d30290b17378 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/action" status: 202 len: 0 microversion: 2.1 time: 0.108438 Aug 01 14:16:54.313714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 486/985] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:16:54 2022] POST /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:16:54.327264 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-24a2bd06-0fa7-4096-9b08-1636ccc77b30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:54.329721 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-24a2bd06-0fa7-4096-9b08-1636ccc77b30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:54.342447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-24a2bd06-0fa7-4096-9b08-1636ccc77b30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:54.343130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-24a2bd06-0fa7-4096-9b08-1636ccc77b30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.345784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-24a2bd06-0fa7-4096-9b08-1636ccc77b30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:54.346372 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-24a2bd06-0fa7-4096-9b08-1636ccc77b30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.511981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-24a2bd06-0fa7-4096-9b08-1636ccc77b30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:54.522065 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-24a2bd06-0fa7-4096-9b08-1636ccc77b30 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1663 microversion: 2.1 time: 0.202602 Aug 01 14:16:54.533141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 500/986] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:54 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1663 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:54.743389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-4a6c3880-d030-493f-87b5-e3f43e7675b6 req-4b83d2d5-512b-4e51-aaf9-ca7910c30dcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bc4793-88a4-4bc0-a99d-c5161e63842b", "name": "network-vif-deleted", "tag": "95fff2c9-f9b3-439e-a613-9ea37938dcf9"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:16:54.766682 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4a6c3880-d030-493f-87b5-e3f43e7675b6 req-4b83d2d5-512b-4e51-aaf9-ca7910c30dcd service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:54.768181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4a6c3880-d030-493f-87b5-e3f43e7675b6 req-4b83d2d5-512b-4e51-aaf9-ca7910c30dcd service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:54.790899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-4a6c3880-d030-493f-87b5-e3f43e7675b6 req-4b83d2d5-512b-4e51-aaf9-ca7910c30dcd service nova] Creating event network-vif-deleted:95fff2c9-f9b3-439e-a613-9ea37938dcf9 for instance c9bc4793-88a4-4bc0-a99d-c5161e63842b on hv-cinder-84713 Aug 01 14:16:54.800268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-4a6c3880-d030-493f-87b5-e3f43e7675b6 req-4b83d2d5-512b-4e51-aaf9-ca7910c30dcd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063148 Aug 01 14:16:54.802306 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 487/987] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:16:55.288113 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:55.290031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:55.296414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:55.296983 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:55.297825 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:55.298336 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:55.333253 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:55.333979 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:55.334519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lazy-loading 'fault' on Instance uuid c9bc4793-88a4-4bc0-a99d-c5161e63842b {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:16:55.391032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:55.401078 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2540aaf8-9eb5-4893-bebf-0fd93c5be2e9 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 200 len: 1336 microversion: 2.1 time: 0.116261 Aug 01 14:16:55.401681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 501/988] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:55 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 1336 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:55.546534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ab71ecd-8b96-40fc-9e7a-92cb660c4fd3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:55.547275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6ab71ecd-8b96-40fc-9e7a-92cb660c4fd3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:55.553939 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ab71ecd-8b96-40fc-9e7a-92cb660c4fd3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:55.554393 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ab71ecd-8b96-40fc-9e7a-92cb660c4fd3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:55.555192 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ab71ecd-8b96-40fc-9e7a-92cb660c4fd3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:55.555635 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ab71ecd-8b96-40fc-9e7a-92cb660c4fd3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:55.749392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6ab71ecd-8b96-40fc-9e7a-92cb660c4fd3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:55.763196 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6ab71ecd-8b96-40fc-9e7a-92cb660c4fd3 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1663 microversion: 2.1 time: 0.221904 Aug 01 14:16:55.763783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 488/989] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:55 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1663 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:56.430722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:56.431343 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: c9bc4793-88a4-4bc0-a99d-c5161e63842b] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:56.438637 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:56.439083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:56.439846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:56.440281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:56.454265 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] HTTP exception thrown: Instance c9bc4793-88a4-4bc0-a99d-c5161e63842b could not be found. Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Request method failure captured: Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b HTTP/1.1 Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_QTP34zCqxkjuzGhNGLJjTdwR4Wdl9YtCoqvRiTXZc35VR0PDFWWOlwBCKUJQGjaghsULTBWYIDh0BETy4ucBH_XjPQZxYfXn1Z8Rmv0h464Jj2L3NqHAUmDGP6rXRjuKMfTyHWkpaKimc-w1uebscESmboyRMBjkIwxCdpVdxS0 Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:16:56.455914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}] Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: f379b005418a4e399c3b72cbbef6e00d Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance c9bc4793-88a4-4bc0-a99d-c5161e63842b could not be found. Aug 01 14:16:56.458585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': 'c9bc4793-88a4-4bc0-a99d-c5161e63842b'} Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9bc4793-88a4-4bc0-a99d-c5161e63842b could not be found. Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:16:56.460116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9bc4793-88a4-4bc0-a99d-c5161e63842b could not be found. Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9bc4793-88a4-4bc0-a99d-c5161e63842b could not be found. Aug 01 14:16:56.462681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:16:56.465152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Returning 404 to user: Instance c9bc4793-88a4-4bc0-a99d-c5161e63842b could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:16:56.465152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5c0fa34d-3f73-415a-bddb-a37c1de5c1ca tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b" status: 404 len: 111 microversion: 2.1 time: 0.030539 Aug 01 14:16:56.465152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 502/990] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:56 2022] GET /compute/v2.1/servers/c9bc4793-88a4-4bc0-a99d-c5161e63842b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:16:56.468760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-82b3bcfa-f00a-44e5-95bb-8aaabcaae034 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '.version_select at 0x7f4462d51ca0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:56.488910 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-82b3bcfa-f00a-44e5-95bb-8aaabcaae034 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132266031" status: 202 len: 0 microversion: 2.1 time: 0.024829 Aug 01 14:16:56.489488 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 489/991] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 14:16:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132266031 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:16:56.785312 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-949e578d-7752-410c-8bdf-95799da0b045 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:56.785941 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-949e578d-7752-410c-8bdf-95799da0b045 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:56.793410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-949e578d-7752-410c-8bdf-95799da0b045 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:56.793868 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-949e578d-7752-410c-8bdf-95799da0b045 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:56.794883 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-949e578d-7752-410c-8bdf-95799da0b045 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:56.795329 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-949e578d-7752-410c-8bdf-95799da0b045 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:56.947181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-949e578d-7752-410c-8bdf-95799da0b045 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:56.955779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-949e578d-7752-410c-8bdf-95799da0b045 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1663 microversion: 2.1 time: 0.174538 Aug 01 14:16:56.956352 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 503/992] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:56 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1663 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:16:57.978684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5562b8f1-6586-4925-95fe-8e9405dbc695 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:57.979956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5562b8f1-6586-4925-95fe-8e9405dbc695 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:57.986638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5562b8f1-6586-4925-95fe-8e9405dbc695 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:57.987183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5562b8f1-6586-4925-95fe-8e9405dbc695 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:57.988089 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5562b8f1-6586-4925-95fe-8e9405dbc695 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:57.988618 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5562b8f1-6586-4925-95fe-8e9405dbc695 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:58.125596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5562b8f1-6586-4925-95fe-8e9405dbc695 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:58.133353 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5562b8f1-6586-4925-95fe-8e9405dbc695 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1667 microversion: 2.1 time: 0.159584 Aug 01 14:16:58.133922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 490/993] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:57 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1667 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:16:59.436016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-61455dff-ee18-4e59-91c0-106d6975842f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:59.436925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-61455dff-ee18-4e59-91c0-106d6975842f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:59.442237 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:59.448435 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-61455dff-ee18-4e59-91c0-106d6975842f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.448974 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-61455dff-ee18-4e59-91c0-106d6975842f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:59.449810 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-61455dff-ee18-4e59-91c0-106d6975842f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.450286 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-61455dff-ee18-4e59-91c0-106d6975842f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:59.476197 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-61455dff-ee18-4e59-91c0-106d6975842f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:16:59.554098 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-61455dff-ee18-4e59-91c0-106d6975842f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 204 len: 0 microversion: 2.1 time: 0.124498 Aug 01 14:16:59.555088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 504/994] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:16:59 2022] DELETE /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:16:59.565204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f184b9ac-3f24-4737-8cd9-ca264efe41d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:16:59.566502 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f184b9ac-3f24-4737-8cd9-ca264efe41d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:16:59.569533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:59.576223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f184b9ac-3f24-4737-8cd9-ca264efe41d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.576692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f184b9ac-3f24-4737-8cd9-ca264efe41d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:59.577462 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f184b9ac-3f24-4737-8cd9-ca264efe41d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:16:59.577896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f184b9ac-3f24-4737-8cd9-ca264efe41d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:16:59.717202 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f184b9ac-3f24-4737-8cd9-ca264efe41d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:16:59.725524 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f184b9ac-3f24-4737-8cd9-ca264efe41d2 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1508 microversion: 2.1 time: 0.164826 Aug 01 14:16:59.726582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 491/995] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:16:59 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:00.749844 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a8f77dcc-2df0-4763-86b5-e8f9e1e29286 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:00.750707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a8f77dcc-2df0-4763-86b5-e8f9e1e29286 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:00.757979 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8f77dcc-2df0-4763-86b5-e8f9e1e29286 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:00.758424 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8f77dcc-2df0-4763-86b5-e8f9e1e29286 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:00.759194 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8f77dcc-2df0-4763-86b5-e8f9e1e29286 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:00.759625 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a8f77dcc-2df0-4763-86b5-e8f9e1e29286 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:00.914957 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a8f77dcc-2df0-4763-86b5-e8f9e1e29286 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:00.927626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a8f77dcc-2df0-4763-86b5-e8f9e1e29286 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 200 len: 1508 microversion: 2.1 time: 0.183091 Aug 01 14:17:00.928605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 505/996] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:00 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 1508 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:01.068042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-78bd8a2b-69d9-44d1-9fe3-cb01f89a8cf4 req-726fdcce-3300-41cb-953e-18c73a5c57db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8437bc61-6b11-4e15-afb8-f748b55a9e06", "name": "network-vif-deleted", "tag": "b980b564-8216-40d9-b117-a88ee864fd73"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:01.095848 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-78bd8a2b-69d9-44d1-9fe3-cb01f89a8cf4 req-726fdcce-3300-41cb-953e-18c73a5c57db service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:01.096590 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-78bd8a2b-69d9-44d1-9fe3-cb01f89a8cf4 req-726fdcce-3300-41cb-953e-18c73a5c57db service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:01.122729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-78bd8a2b-69d9-44d1-9fe3-cb01f89a8cf4 req-726fdcce-3300-41cb-953e-18c73a5c57db service nova] Creating event network-vif-deleted:b980b564-8216-40d9-b117-a88ee864fd73 for instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 on hv-cinder-84713 Aug 01 14:17:01.128468 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-78bd8a2b-69d9-44d1-9fe3-cb01f89a8cf4 req-726fdcce-3300-41cb-953e-18c73a5c57db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067383 Aug 01 14:17:01.129573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 492/997] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:01.948349 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:01.949009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: 8437bc61-6b11-4e15-afb8-f748b55a9e06] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:01.955633 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:01.956091 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:01.956897 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:01.957340 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:01.970453 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] HTTP exception thrown: Instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 could not be found. Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Request method failure captured: Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 HTTP/1.1 Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_QTP34zCqxkjuzGhNGLJjTdwR4Wdl9YtCoqvRiTXZc35VR0PDFWWOlwBCKUJQGjaghsULTBWYIDh0BETy4ucBH_XjPQZxYfXn1Z8Rmv0h464Jj2L3NqHAUmDGP6rXRjuKMfTyHWkpaKimc-w1uebscESmboyRMBjkIwxCdpVdxS0 Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:17:01.972089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}] Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: f379b005418a4e399c3b72cbbef6e00d Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 could not be found. Aug 01 14:17:01.973675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '8437bc61-6b11-4e15-afb8-f748b55a9e06'} Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 could not be found. Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:01.974501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 could not be found. Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 could not be found. Aug 01 14:17:01.975862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:01.977345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Returning 404 to user: Instance 8437bc61-6b11-4e15-afb8-f748b55a9e06 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:01.977345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-458c0b3e-161f-4a8c-aa54-0e386c51741d tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06" status: 404 len: 111 microversion: 2.1 time: 0.029345 Aug 01 14:17:01.977345 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 506/998] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:01 2022] GET /compute/v2.1/servers/8437bc61-6b11-4e15-afb8-f748b55a9e06 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:17:01.983582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5565f970-9e0e-46ac-bb45-54518ea82c8b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:01.984156 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5565f970-9e0e-46ac-bb45-54518ea82c8b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:01.990642 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5565f970-9e0e-46ac-bb45-54518ea82c8b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:01.991092 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5565f970-9e0e-46ac-bb45-54518ea82c8b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:01.991845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5565f970-9e0e-46ac-bb45-54518ea82c8b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:01.992276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5565f970-9e0e-46ac-bb45-54518ea82c8b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:02.017749 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5565f970-9e0e-46ac-bb45-54518ea82c8b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:17:02.093949 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5565f970-9e0e-46ac-bb45-54518ea82c8b tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 204 len: 0 microversion: 2.1 time: 0.114223 Aug 01 14:17:02.094714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 493/999] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:17:01 2022] DELETE /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:17:02.104638 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-43f9b43e-3c8f-4e82-8919-3c52b2d95645 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:02.105416 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-43f9b43e-3c8f-4e82-8919-3c52b2d95645 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:02.112748 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43f9b43e-3c8f-4e82-8919-3c52b2d95645 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:02.113348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43f9b43e-3c8f-4e82-8919-3c52b2d95645 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:02.114278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43f9b43e-3c8f-4e82-8919-3c52b2d95645 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:02.114816 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-43f9b43e-3c8f-4e82-8919-3c52b2d95645 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:02.253161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-43f9b43e-3c8f-4e82-8919-3c52b2d95645 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:02.260721 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-43f9b43e-3c8f-4e82-8919-3c52b2d95645 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.161244 Aug 01 14:17:02.261286 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 507/1000] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:02 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:17:03.282030 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-834ec2e0-f868-421c-810a-f235a83baf5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:03.282726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-834ec2e0-f868-421c-810a-f235a83baf5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:03.289344 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834ec2e0-f868-421c-810a-f235a83baf5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:03.289785 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834ec2e0-f868-421c-810a-f235a83baf5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:03.291035 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834ec2e0-f868-421c-810a-f235a83baf5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:03.291463 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834ec2e0-f868-421c-810a-f235a83baf5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:03.502711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-834ec2e0-f868-421c-810a-f235a83baf5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f379b005418a4e399c3b72cbbef6e00d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '670dbffe4aed43c6afc3899ff59b8040', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:17:03.510368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-834ec2e0-f868-421c-810a-f235a83baf5f tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 200 len: 1522 microversion: 2.1 time: 0.232561 Aug 01 14:17:03.510949 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 494/1001] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:03 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:17:03.871879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-530cb660-29c4-4894-9408-c1e6f52d31b6 req-51234975-e272-42a7-b430-a67d5837a183 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8fa6e78-136c-4153-a57c-926647075a19", "name": "network-vif-deleted", "tag": "f9d5077c-63d1-442e-b8ce-cf6ff90efb92"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:03.884667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-530cb660-29c4-4894-9408-c1e6f52d31b6 req-51234975-e272-42a7-b430-a67d5837a183 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:03.885142 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-530cb660-29c4-4894-9408-c1e6f52d31b6 req-51234975-e272-42a7-b430-a67d5837a183 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:03.898279 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-530cb660-29c4-4894-9408-c1e6f52d31b6 req-51234975-e272-42a7-b430-a67d5837a183 service nova] Creating event network-vif-deleted:f9d5077c-63d1-442e-b8ce-cf6ff90efb92 for instance e8fa6e78-136c-4153-a57c-926647075a19 on hv-cinder-84713 Aug 01 14:17:03.904739 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-530cb660-29c4-4894-9408-c1e6f52d31b6 req-51234975-e272-42a7-b430-a67d5837a183 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037176 Aug 01 14:17:03.905338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 508/1002] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:04.531719 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:04.532343 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] [instance: e8fa6e78-136c-4153-a57c-926647075a19] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:17:04.538944 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:04.539668 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:04.541044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:17:04.541487 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:17:04.555956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] HTTP exception thrown: Instance e8fa6e78-136c-4153-a57c-926647075a19 could not be found. Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Request method failure captured: Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 HTTP/1.1 Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_QTP34zCqxkjuzGhNGLJjTdwR4Wdl9YtCoqvRiTXZc35VR0PDFWWOlwBCKUJQGjaghsULTBWYIDh0BETy4ucBH_XjPQZxYfXn1Z8Rmv0h464Jj2L3NqHAUmDGP6rXRjuKMfTyHWkpaKimc-w1uebscESmboyRMBjkIwxCdpVdxS0 Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:17:04.557665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_670dbffe4aed43c6afc3899ff59b8040"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/670dbffe4aed43c6afc3899ff59b8040"}]}] Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 670dbffe4aed43c6afc3899ff59b8040 Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-953171937 Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: f379b005418a4e399c3b72cbbef6e00d Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-953171937-project Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance e8fa6e78-136c-4153-a57c-926647075a19 could not be found. Aug 01 14:17:04.558984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'e8fa6e78-136c-4153-a57c-926647075a19'} Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8fa6e78-136c-4153-a57c-926647075a19 could not be found. Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:04.559904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8fa6e78-136c-4153-a57c-926647075a19 could not be found. Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8fa6e78-136c-4153-a57c-926647075a19 could not be found. Aug 01 14:17:04.561869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:04.562956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] Returning 404 to user: Instance e8fa6e78-136c-4153-a57c-926647075a19 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:04.562956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a9103a1d-2581-48bd-8717-20dd78577603 tempest-ServerRescueNegativeTestJSON-953171937 tempest-ServerRescueNegativeTestJSON-953171937-project] 10.222.0.48 "GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19" status: 404 len: 111 microversion: 2.1 time: 0.031296 Aug 01 14:17:04.562956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 495/1003] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:17:04 2022] GET /compute/v2.1/servers/e8fa6e78-136c-4153-a57c-926647075a19 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:17:09.199968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e991d8eb-d278-45f5-9188-b8b540d4ffdd tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Action: 'create', calling method: .version_select at 0x7f4462dedee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1975245540"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:09.495316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e991d8eb-d278-45f5-9188-b8b540d4ffdd tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.436047 Aug 01 14:17:09.495944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 509/1004] 10.222.0.48 () {60 vars in 1155 bytes} [Mon Aug 1 14:17:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 438 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 01 14:17:09.509432 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b46fd791-653f-4b61-9ed1-c70c474385a2 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462b8c820>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:09.557891 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b46fd791-653f-4b61-9ed1-c70c474385a2 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f" status: 200 len: 345 microversion: 2.1 time: 0.053586 Aug 01 14:17:09.558458 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 496/1005] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:17:09 2022] GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:10.572031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5e6fedc9-b780-4ec0-90ba-4cf0fc15c15a tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462c99430>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:10.616567 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5e6fedc9-b780-4ec0-90ba-4cf0fc15c15a tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f" status: 200 len: 346 microversion: 2.1 time: 0.049297 Aug 01 14:17:10.617125 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 510/1006] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:17:10 2022] GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:10.630568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-77397406-2459-4b49-92df-9d6f8cde0982 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Action: 'create', calling method: .version_select at 0x7f4462d51c10>, body: {"snapshot": {"volume_id": "8a53211b-5bce-4fb6-bd28-4ea732ed079f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2038631332"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:17:10.780302 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-77397406-2459-4b49-92df-9d6f8cde0982 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.154128 Aug 01 14:17:10.780942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 497/1007] 10.222.0.48 () {60 vars in 1162 bytes} [Mon Aug 1 14:17:10 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:10.792111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5ecf0423-d0db-4390-9c04-4e6615976083 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462d3ff70>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:10.825762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5ecf0423-d0db-4390-9c04-4e6615976083 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 200 len: 287 microversion: 2.1 time: 0.037866 Aug 01 14:17:10.826451 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 511/1008] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:10 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:10.838087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-66e5ec93-7deb-4e4d-8d9e-398f922645b1 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462db0790>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:10.867395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-66e5ec93-7deb-4e4d-8d9e-398f922645b1 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033643 Aug 01 14:17:10.867960 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 498/1009] 10.222.0.48 () {58 vars in 1140 bytes} [Mon Aug 1 14:17:10 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:17:10.878947 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fcbc3b82-f017-4c3c-870b-f3c83488c0da tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462cb4d30>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:10.908795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fcbc3b82-f017-4c3c-870b-f3c83488c0da tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 200 len: 287 microversion: 2.1 time: 0.033619 Aug 01 14:17:10.909375 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 512/1010] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:10 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:11.922152 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-664a3ae5-7bb7-4dfa-8e65-77ad11584745 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462ee29d0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:11.951225 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-664a3ae5-7bb7-4dfa-8e65-77ad11584745 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 200 len: 287 microversion: 2.1 time: 0.033267 Aug 01 14:17:11.951780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 499/1011] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:11 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:12.964193 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8cbdc5b7-0a27-4f20-8e0a-67199e3912a8 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462ded040>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:12.992359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8cbdc5b7-0a27-4f20-8e0a-67199e3912a8 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 200 len: 287 microversion: 2.1 time: 0.033052 Aug 01 14:17:12.992968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 513/1012] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:12 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:14.005539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2705e4d-fe60-4902-999c-fedbce3b209d tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462cebd30>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:14.040344 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2705e4d-fe60-4902-999c-fedbce3b209d tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 200 len: 287 microversion: 2.1 time: 0.039107 Aug 01 14:17:14.040953 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 500/1013] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:13 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:17:15.049713 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:15.050493 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:15.055604 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1db6556f-c632-455b-b93a-51237d3e9251 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462d594c0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:15.086255 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1db6556f-c632-455b-b93a-51237d3e9251 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 200 len: 287 microversion: 2.1 time: 0.037295 Aug 01 14:17:15.086823 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 514/1014] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:15 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:16.095803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:16.096503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:17:16.100798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4f81ee2b-f29c-489a-80e8-5ca74a98c738 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462b8c700>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:16.132281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4f81ee2b-f29c-489a-80e8-5ca74a98c738 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 200 len: 288 microversion: 2.1 time: 0.037297 Aug 01 14:17:16.132887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 501/1015] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:16 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 288 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:16.144093 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ba02780f-8e41-4d4f-9b4f-9f0d70e0c0a1 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f44692d2ee0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:16.199848 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ba02780f-8e41-4d4f-9b4f-9f0d70e0c0a1 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 202 len: 0 microversion: 2.1 time: 0.059843 Aug 01 14:17:16.200413 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 515/1016] 10.222.0.48 () {58 vars in 1254 bytes} [Mon Aug 1 14:17:16 2022] DELETE /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:17:16.208584 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9e685bea-80e3-4b53-8a44-d73eec810226 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462b8cf70>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:16.239045 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9e685bea-80e3-4b53-8a44-d73eec810226 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 200 len: 287 microversion: 2.1 time: 0.034266 Aug 01 14:17:16.239604 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 502/1017] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:16 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:17.252502 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-38a44d01-1543-4d7a-8030-ca4ea1402eea tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462c99af0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:17.276861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-38a44d01-1543-4d7a-8030-ca4ea1402eea tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] HTTP exception thrown: Snapshot 3c3dbb03-2a9d-40df-9a25-6f4275c9d57c could not be found. Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-38a44d01-1543-4d7a-8030-ca4ea1402eea tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Request method failure captured: Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c HTTP/1.1 Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi5-BkPHzvPkexlMyAzJXodi7eHqBI2WZWtVML5IuO_jVVV0WoFuzlqiQdK8Fv86-IwoV1mNWM7ZejOgBiChKbKCqF5IRCIiDWG_qlHwWw9gwpdD82TRvZtsxGtQ8-Rb40tXPOCGk6-ikAE03YD9SelIfBJag-CMkYoOk21iIPSWi4PAQ Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: b52bbd619aab41a2a5db484a67f4ee66 Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:17:17.279626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b52bbd619aab41a2a5db484a67f4ee66"}]}] Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: b52bbd619aab41a2a5db484a67f4ee66 Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-VolumesSnapshotsTestJSON-1408274882-project Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 28314ed2f77c4d6f8edfd35941d4d554 Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1408274882-project Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Snapshot 3c3dbb03-2a9d-40df-9a25-6f4275c9d57c could not be found. Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '3c3dbb03-2a9d-40df-9a25-6f4275c9d57c'} Aug 01 14:17:17.281243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3c3dbb03-2a9d-40df-9a25-6f4275c9d57c could not be found. (HTTP 404) (Request-ID: req-4d013fb7-26fc-4fa9-9b37-129c843a7f91) Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:17.282199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:17:17.283605 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3c3dbb03-2a9d-40df-9a25-6f4275c9d57c could not be found. Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 01 14:17:17.285382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3c3dbb03-2a9d-40df-9a25-6f4275c9d57c could not be found. Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3c3dbb03-2a9d-40df-9a25-6f4275c9d57c could not be found. Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-38a44d01-1543-4d7a-8030-ca4ea1402eea tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Returning 404 to user: Snapshot 3c3dbb03-2a9d-40df-9a25-6f4275c9d57c could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:17.287135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-38a44d01-1543-4d7a-8030-ca4ea1402eea tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c" status: 404 len: 111 microversion: 2.1 time: 0.032856 Aug 01 14:17:17.288129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 516/1018] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:17:17 2022] GET /compute/v2.1/os-snapshots/3c3dbb03-2a9d-40df-9a25-6f4275c9d57c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:17:17.290381 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6e2a406f-38a6-463e-a456-2a52bad3b499 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462db0e50>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:17.350587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6e2a406f-38a6-463e-a456-2a52bad3b499 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f" status: 202 len: 0 microversion: 2.1 time: 0.064498 Aug 01 14:17:17.351159 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 503/1019] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:17:17 2022] DELETE /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:17:17.359323 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-423248ce-d4bc-4e45-b053-7e17664077a1 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f44692d2ee0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:17.407067 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-423248ce-d4bc-4e45-b053-7e17664077a1 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f" status: 200 len: 345 microversion: 2.1 time: 0.051393 Aug 01 14:17:17.407644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 517/1020] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:17:17 2022] GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:17:18.421780 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-99c33c34-b8e7-4a07-9c72-01f81c9276ad tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462b8cb80>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:18.450393 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-99c33c34-b8e7-4a07-9c72-01f81c9276ad tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] HTTP exception thrown: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-99c33c34-b8e7-4a07-9c72-01f81c9276ad tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Request method failure captured: Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f HTTP/1.1 Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi5-BkPHzvPkexlMyAzJXodi7eHqBI2WZWtVML5IuO_jVVV0WoFuzlqiQdK8Fv86-IwoV1mNWM7ZejOgBiChKbKCqF5IRCIiDWG_qlHwWw9gwpdD82TRvZtsxGtQ8-Rb40tXPOCGk6-ikAE03YD9SelIfBJag-CMkYoOk21iIPSWi4PAQ Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: b52bbd619aab41a2a5db484a67f4ee66 Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:17:18.453175 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b52bbd619aab41a2a5db484a67f4ee66"}]}] Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: b52bbd619aab41a2a5db484a67f4ee66 Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotsTestJSON-1408274882-project Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 28314ed2f77c4d6f8edfd35941d4d554 Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1408274882-project Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '8a53211b-5bce-4fb6-bd28-4ea732ed079f'} Aug 01 14:17:18.454760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. (HTTP 404) (Request-ID: req-6f0fe882-6a9d-4fb8-afb5-f9751e4137bd) Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.455821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:17:18.457358 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:17:18.459073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-99c33c34-b8e7-4a07-9c72-01f81c9276ad tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Returning 404 to user: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-99c33c34-b8e7-4a07-9c72-01f81c9276ad tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f" status: 404 len: 109 microversion: 2.1 time: 0.037179 Aug 01 14:17:18.460769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 504/1021] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:17:18 2022] GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:17:18.471026 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-32e6850f-ce3c-4d04-8548-850d800fbe31 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462d3f040>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:18.497882 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-32e6850f-ce3c-4d04-8548-850d800fbe31 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] HTTP exception thrown: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-32e6850f-ce3c-4d04-8548-850d800fbe31 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Request method failure captured: Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f HTTP/1.1 Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi5-BkPHzvPkexlMyAzJXodi7eHqBI2WZWtVML5IuO_jVVV0WoFuzlqiQdK8Fv86-IwoV1mNWM7ZejOgBiChKbKCqF5IRCIiDWG_qlHwWw9gwpdD82TRvZtsxGtQ8-Rb40tXPOCGk6-ikAE03YD9SelIfBJag-CMkYoOk21iIPSWi4PAQ Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: b52bbd619aab41a2a5db484a67f4ee66 Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:17:18.500192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b52bbd619aab41a2a5db484a67f4ee66"}]}] Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: b52bbd619aab41a2a5db484a67f4ee66 Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-VolumesSnapshotsTestJSON-1408274882-project Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 28314ed2f77c4d6f8edfd35941d4d554 Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1408274882-project Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '8a53211b-5bce-4fb6-bd28-4ea732ed079f'} Aug 01 14:17:18.501729 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. (HTTP 404) (Request-ID: req-2284299f-f123-4e40-bf7f-2327e95c898a) Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.502652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 01 14:17:18.503987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 01 14:17:18.505524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-32e6850f-ce3c-4d04-8548-850d800fbe31 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Returning 404 to user: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:18.506908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-32e6850f-ce3c-4d04-8548-850d800fbe31 tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f" status: 404 len: 109 microversion: 2.1 time: 0.035211 Aug 01 14:17:18.508397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 518/1022] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:17:18 2022] DELETE /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:17:18.510851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-01f72550-a093-43c8-80ee-43c24015315c tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Calling method '.version_select at 0x7f4462db01f0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:17:18.538528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-01f72550-a093-43c8-80ee-43c24015315c tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] HTTP exception thrown: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-01f72550-a093-43c8-80ee-43c24015315c tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Request method failure captured: Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f HTTP/1.1 Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi5-BkPHzvPkexlMyAzJXodi7eHqBI2WZWtVML5IuO_jVVV0WoFuzlqiQdK8Fv86-IwoV1mNWM7ZejOgBiChKbKCqF5IRCIiDWG_qlHwWw9gwpdD82TRvZtsxGtQ8-Rb40tXPOCGk6-ikAE03YD9SelIfBJag-CMkYoOk21iIPSWi4PAQ Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: b52bbd619aab41a2a5db484a67f4ee66 Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:17:18.540508 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b52bbd619aab41a2a5db484a67f4ee66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b52bbd619aab41a2a5db484a67f4ee66"}]}] Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: b52bbd619aab41a2a5db484a67f4ee66 Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1408274882 Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotsTestJSON-1408274882-project Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 28314ed2f77c4d6f8edfd35941d4d554 Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1408274882-project Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '8a53211b-5bce-4fb6-bd28-4ea732ed079f'} Aug 01 14:17:18.541885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. (HTTP 404) (Request-ID: req-0a361923-8795-4314-9e4d-257488fc70b5) Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.542718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 01 14:17:18.544053 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 01 14:17:18.545395 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-01f72550-a093-43c8-80ee-43c24015315c tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] Returning 404 to user: Volume 8a53211b-5bce-4fb6-bd28-4ea732ed079f could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-01f72550-a093-43c8-80ee-43c24015315c tempest-VolumesSnapshotsTestJSON-1408274882 tempest-VolumesSnapshotsTestJSON-1408274882-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f" status: 404 len: 109 microversion: 2.1 time: 0.035451 Aug 01 14:17:18.546696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 505/1023] 10.222.0.48 () {58 vars in 1245 bytes} [Mon Aug 1 14:17:18 2022] GET /compute/v2.1/os-volumes/8a53211b-5bce-4fb6-bd28-4ea732ed079f => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:18:24.354320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-73585fef-6c74-417e-83c1-43dc668518f9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:24.354932 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-73585fef-6c74-417e-83c1-43dc668518f9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:24.361205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73585fef-6c74-417e-83c1-43dc668518f9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:24.361656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73585fef-6c74-417e-83c1-43dc668518f9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:24.362412 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73585fef-6c74-417e-83c1-43dc668518f9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:24.362847 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-73585fef-6c74-417e-83c1-43dc668518f9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:24.387420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-73585fef-6c74-417e-83c1-43dc668518f9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/ips" status: 200 len: 151 microversion: 2.1 time: 0.038521 Aug 01 14:18:24.388007 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 519/1024] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:18:24 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:25.755309 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b048e567-1268-4958-9aea-8e0d63a78b03 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a6eb349-4c16-4ab4-a615-fcd75546fd83"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:25.756509 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b048e567-1268-4958-9aea-8e0d63a78b03 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:25.764005 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b048e567-1268-4958-9aea-8e0d63a78b03 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:25.764446 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b048e567-1268-4958-9aea-8e0d63a78b03 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:25.765240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b048e567-1268-4958-9aea-8e0d63a78b03 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:25.765704 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b048e567-1268-4958-9aea-8e0d63a78b03 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:26.046253 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b048e567-1268-4958-9aea-8e0d63a78b03 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297846 Aug 01 14:18:26.046891 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 506/1025] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:18:25 2022] POST /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:27.096688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c8908c3a-c334-4705-8b04-039a9594764b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:27.097220 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c8908c3a-c334-4705-8b04-039a9594764b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:27.103559 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c8908c3a-c334-4705-8b04-039a9594764b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.104006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c8908c3a-c334-4705-8b04-039a9594764b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:27.104795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c8908c3a-c334-4705-8b04-039a9594764b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.105234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c8908c3a-c334-4705-8b04-039a9594764b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:27.128076 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c8908c3a-c334-4705-8b04-039a9594764b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/ips" status: 200 len: 152 microversion: 2.20 time: 0.035425 Aug 01 14:18:27.128682 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 520/1026] 10.222.0.48 () {60 vars in 1289 bytes} [Mon Aug 1 14:18:27 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 01 14:18:27.666738 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ee6fe298-8ff0-4f8a-82f5-af7344409fef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:27.669744 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ee6fe298-8ff0-4f8a-82f5-af7344409fef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:27.675932 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ee6fe298-8ff0-4f8a-82f5-af7344409fef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.676383 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ee6fe298-8ff0-4f8a-82f5-af7344409fef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:27.677180 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ee6fe298-8ff0-4f8a-82f5-af7344409fef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.677615 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ee6fe298-8ff0-4f8a-82f5-af7344409fef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:27.706268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ee6fe298-8ff0-4f8a-82f5-af7344409fef tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044357 Aug 01 14:18:27.706819 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 507/1027] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:18:27 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:18:27.768161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-290fa465-3f8e-4799-b99a-a4bbe5bacc9a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:27.768701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-290fa465-3f8e-4799-b99a-a4bbe5bacc9a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:27.774650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-290fa465-3f8e-4799-b99a-a4bbe5bacc9a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.775188 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-290fa465-3f8e-4799-b99a-a4bbe5bacc9a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:27.775968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-290fa465-3f8e-4799-b99a-a4bbe5bacc9a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.777017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-290fa465-3f8e-4799-b99a-a4bbe5bacc9a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:27.800913 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-290fa465-3f8e-4799-b99a-a4bbe5bacc9a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:18:27.873712 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-290fa465-3f8e-4799-b99a-a4bbe5bacc9a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 204 len: 0 microversion: 2.1 time: 0.109159 Aug 01 14:18:27.874218 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 521/1028] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:18:27 2022] DELETE /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:18:27.882632 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a8d3f6bc-d448-44ce-a74d-07eef7735f2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:27.883247 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a8d3f6bc-d448-44ce-a74d-07eef7735f2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:27.890208 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a8d3f6bc-d448-44ce-a74d-07eef7735f2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.890655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a8d3f6bc-d448-44ce-a74d-07eef7735f2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:27.891420 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a8d3f6bc-d448-44ce-a74d-07eef7735f2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:27.891840 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a8d3f6bc-d448-44ce-a74d-07eef7735f2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:28.028845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a8d3f6bc-d448-44ce-a74d-07eef7735f2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:28.036231 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a8d3f6bc-d448-44ce-a74d-07eef7735f2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1673 microversion: 2.1 time: 0.157460 Aug 01 14:18:28.036998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 508/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:27 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:29.058722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f393df37-a29e-43ff-aa21-a92f1e5e3eae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:29.059332 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f393df37-a29e-43ff-aa21-a92f1e5e3eae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:29.066903 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f393df37-a29e-43ff-aa21-a92f1e5e3eae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:29.067615 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f393df37-a29e-43ff-aa21-a92f1e5e3eae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:29.068383 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f393df37-a29e-43ff-aa21-a92f1e5e3eae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:29.069039 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f393df37-a29e-43ff-aa21-a92f1e5e3eae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:29.095073 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0616b13b-2bd6-4fad-afdf-b82337783375 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:29.096231 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0616b13b-2bd6-4fad-afdf-b82337783375 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:29.102772 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0616b13b-2bd6-4fad-afdf-b82337783375 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:29.103224 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0616b13b-2bd6-4fad-afdf-b82337783375 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:29.103994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0616b13b-2bd6-4fad-afdf-b82337783375 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:29.104433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0616b13b-2bd6-4fad-afdf-b82337783375 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:29.127755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-0616b13b-2bd6-4fad-afdf-b82337783375 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lazy-loading 'flavor' on Instance uuid 900b90f4-dd21-4df9-a880-5760f2c62ae5 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:18:29.210914 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f393df37-a29e-43ff-aa21-a92f1e5e3eae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:29.219519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f393df37-a29e-43ff-aa21-a92f1e5e3eae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1673 microversion: 2.1 time: 0.165683 Aug 01 14:18:29.221134 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 522/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:29 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:29.324916 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0616b13b-2bd6-4fad-afdf-b82337783375 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/action" status: 202 len: 0 microversion: 2.20 time: 0.233565 Aug 01 14:18:29.325513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 509/1031] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 14:18:29 2022] POST /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:18:29.333588 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:29.334203 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:29.340441 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:29.340920 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:29.341680 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:29.342116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:29.477370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:29.485880 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:29.487403 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:29.488595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8cd2f5a1-69c5-4c77-82ad-9643963e1d98 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.158833 Aug 01 14:18:29.489193 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 523/1032] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:29 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:30.247700 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-602de342-7f41-4472-b1a9-d49ed920c4af tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:30.248407 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-602de342-7f41-4472-b1a9-d49ed920c4af tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:30.256301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-602de342-7f41-4472-b1a9-d49ed920c4af tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:30.256791 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-602de342-7f41-4472-b1a9-d49ed920c4af tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:30.257611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-602de342-7f41-4472-b1a9-d49ed920c4af tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:30.258060 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-602de342-7f41-4472-b1a9-d49ed920c4af tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:30.515800 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:30.516425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:30.523778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:30.524236 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:30.525067 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:30.525512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:30.559374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-602de342-7f41-4472-b1a9-d49ed920c4af tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:30.569154 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-602de342-7f41-4472-b1a9-d49ed920c4af tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 200 len: 1606 microversion: 2.1 time: 0.327234 Aug 01 14:18:30.570199 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 510/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:30 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 1606 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:30.647514 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-74e7611e-c4f5-41e1-89e0-fa17a7b86d23 req-a84b31b9-9b75-41b8-8a15-7d0d1d973dcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb60b84-0a48-4c71-90d0-bb0ad32e66a3", "name": "network-vif-deleted", "tag": "ca8de692-90c9-403a-8384-f27a86a2d499"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:30.658837 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-74e7611e-c4f5-41e1-89e0-fa17a7b86d23 req-a84b31b9-9b75-41b8-8a15-7d0d1d973dcc service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:30.659291 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-74e7611e-c4f5-41e1-89e0-fa17a7b86d23 req-a84b31b9-9b75-41b8-8a15-7d0d1d973dcc service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:30.673331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-74e7611e-c4f5-41e1-89e0-fa17a7b86d23 req-a84b31b9-9b75-41b8-8a15-7d0d1d973dcc service nova] Creating event network-vif-deleted:ca8de692-90c9-403a-8384-f27a86a2d499 for instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 on hv-cinder-84713 Aug 01 14:18:30.688212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-74e7611e-c4f5-41e1-89e0-fa17a7b86d23 req-a84b31b9-9b75-41b8-8a15-7d0d1d973dcc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046289 Aug 01 14:18:30.689147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 511/1034] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:30.696140 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:30.704943 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:30.706469 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:30.707663 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-59b5bebc-c3cc-4bcc-b835-2539b234d8ed tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.195807 Aug 01 14:18:30.708250 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 524/1035] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:30 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:31.597908 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:31.598603 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:31.605867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:31.606337 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:31.607124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:31.607565 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:31.624875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] HTTP exception thrown: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Request method failure captured: Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 HTTP/1.1 Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi597pxyUzUD2HaRyYpTAij644BdXRpcMuppXM3MGNd5GVAN1gKfmyppngGgw2V2KmfZ4jHOChvGPQHHMIkxwc8SKdDgHwOb_aWxBxKMznQ0mkSvVQHh_g9JzhiIU4oSCHl9Lan3kQ7p-IbiGibkSe5BwH2B1chcJES154xCECr3G9v_8 Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:18:31.626674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}] Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ebe4b3455a3d4139a1267da97bd83662 Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:18:31.629212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '7eb60b84-0a48-4c71-90d0-bb0ad32e66a3'} Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:18:31.630599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:18:31.633475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:31.635069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Returning 404 to user: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:18:31.635069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-beff543e-6bdb-4b29-8180-e01e333e99fd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 404 len: 111 microversion: 2.1 time: 0.034835 Aug 01 14:18:31.635069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 512/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:31 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:18:31.640117 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ab3dc13a-2db3-49ae-9ead-0a86ad038b5b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '.version_select at 0x7f4462d593a0>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:31.662448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ab3dc13a-2db3-49ae-9ead-0a86ad038b5b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834863452" status: 202 len: 0 microversion: 2.1 time: 0.026354 Aug 01 14:18:31.663407 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 525/1037] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 14:18:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1834863452 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:18:31.732014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:31.732925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:31.739373 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:31.739897 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:31.740978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:31.741636 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:31.916064 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:31.927617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:31.929205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:31.930374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-befdc273-3a4b-4044-9f51-c28f68bc69cc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.202804 Aug 01 14:18:31.930932 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 513/1038] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:31 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:32.386280 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-19ae316c-2c3c-4324-8e7f-6153925ad021 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'create', calling method: .version_select at 0x7f4462ddcd30>, body: {"keypair": {"name": "tempest-keypair-762115004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcoijTSvKjBHc3vdtPLEvZ9qGJ8BpJpNZ1l4O3jzADzIMJJQ717j5T5gPuloAPW2iWc0KgZ1y/uU6IASfLDK8ZvjFghUJSR4ePifHo1B+O5GQNnW5u/iQEXPVK3aklmyQ=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:32.402774 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-19ae316c-2c3c-4324-8e7f-6153925ad021 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Getting quotas for project c3d2b7b0783c4cc7bd0ce59a13f70efa. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:18:32.406540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-19ae316c-2c3c-4324-8e7f-6153925ad021 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Getting quotas for user ebe4b3455a3d4139a1267da97bd83662 and project c3d2b7b0783c4cc7bd0ce59a13f70efa. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:18:32.428860 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-19ae316c-2c3c-4324-8e7f-6153925ad021 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046895 Aug 01 14:18:32.429458 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 526/1039] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:18:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:32.954200 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:32.954815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:32.961424 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:32.961884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:32.962656 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:32.963103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.189239 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:33.198545 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:33.200425 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:33.201973 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-59b4a8fb-94bb-4d8a-8104-bcef95f72f17 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.251772 Aug 01 14:18:33.202712 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 514/1040] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:32 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:33.603294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a6eb349-4c16-4ab4-a615-fcd75546fd83"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:33.606522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:33.612743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:33.613267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.614202 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:33.614635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.695342 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Invalid volume: volume 9a6eb349-4c16-4ab4-a615-fcd75546fd83 is already attached to instances: a0a6965a-e41a-44e6-8317-3a420f00e98f Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: POST /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments HTTP/1.1 Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 74 Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:18:33.697119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {"volumeAttachment": {"volumeId": "9a6eb349-4c16-4ab4-a615-fcd75546fd83"}} Aug 01 14:18:33.699008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Invalid volume: volume 9a6eb349-4c16-4ab4-a615-fcd75546fd83 is already attached to instances: a0a6965a-e41a-44e6-8317-3a420f00e98f Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'server_id': 'a0a6965a-e41a-44e6-8317-3a420f00e98f', 'body': {'volumeAttachment': {'volumeId': '9a6eb349-4c16-4ab4-a615-fcd75546fd83'}}} Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9a6eb349-4c16-4ab4-a615-fcd75546fd83 is already attached to instances: a0a6965a-e41a-44e6-8317-3a420f00e98f Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:18:33.700347 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9a6eb349-4c16-4ab4-a615-fcd75546fd83 is already attached to instances: a0a6965a-e41a-44e6-8317-3a420f00e98f Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:33.701576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:33.702852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:33.702852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:18:33.702852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:18:33.702852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9a6eb349-4c16-4ab4-a615-fcd75546fd83 is already attached to instances: a0a6965a-e41a-44e6-8317-3a420f00e98f Aug 01 14:18:33.702852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:18:33.702852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 400 to user: Invalid volume: volume 9a6eb349-4c16-4ab4-a615-fcd75546fd83 is already attached to instances: a0a6965a-e41a-44e6-8317-3a420f00e98f {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:18:33.702852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b63344e5-7914-486e-9417-baafa8cea3b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100460 Aug 01 14:18:33.702852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 527/1041] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:18:33 2022] POST /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:18:33.767084 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b4565f29-5c57-45b7-a681-58f14b787c4f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:33.767647 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b4565f29-5c57-45b7-a681-58f14b787c4f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:33.773862 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4565f29-5c57-45b7-a681-58f14b787c4f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:33.774477 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4565f29-5c57-45b7-a681-58f14b787c4f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.775523 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4565f29-5c57-45b7-a681-58f14b787c4f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:33.776756 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4565f29-5c57-45b7-a681-58f14b787c4f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.790632 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1097596819", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "997ead77-fabf-46da-9c53-333e78171b19"}], "security_groups": [{"name": "tempest-securitygroup--393269380"}], "key_name": "tempest-keypair-762115004", "user_data": "}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:33.872617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-b4565f29-5c57-45b7-a681-58f14b787c4f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lazy-loading 'services' on Instance uuid a0a6965a-e41a-44e6-8317-3a420f00e98f {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:18:33.897211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] validate_networks() for [('997ead77-fabf-46da-9c53-333e78171b19', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:18:33.944070 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b4565f29-5c57-45b7-a681-58f14b787c4f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments/9a6eb349-4c16-4ab4-a615-fcd75546fd83" status: 202 len: 0 microversion: 2.1 time: 0.180647 Aug 01 14:18:33.944768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 515/1042] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:18:33 2022] DELETE /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments/9a6eb349-4c16-4ab4-a615-fcd75546fd83 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:18:33.953936 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-185f575d-1882-4e1b-85cc-f60cb9198250 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:33.956402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-185f575d-1882-4e1b-85cc-f60cb9198250 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:33.964473 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-185f575d-1882-4e1b-85cc-f60cb9198250 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:33.964946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-185f575d-1882-4e1b-85cc-f60cb9198250 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.965718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-185f575d-1882-4e1b-85cc-f60cb9198250 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:33.966179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-185f575d-1882-4e1b-85cc-f60cb9198250 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:33.996084 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-185f575d-1882-4e1b-85cc-f60cb9198250 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Aug 01 14:18:33.996718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 516/1043] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:18:33 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:34.226220 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:34.226836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:34.233407 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:34.233857 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:34.234624 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:34.235065 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:34.283286 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:18:34.283286 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:18:34.285908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:18:34.285908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:18:34.285908 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:18:34.294138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:34.294591 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:34.295393 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:34.295836 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:34.312428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Getting quotas for project c3d2b7b0783c4cc7bd0ce59a13f70efa. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:18:34.316455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Getting quotas for user ebe4b3455a3d4139a1267da97bd83662 and project c3d2b7b0783c4cc7bd0ce59a13f70efa. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:18:34.328145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:18:34.330503 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:18:34.368217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:34.376219 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:34.377864 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:34.378032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fb0227d8-e5a7-4019-865b-000b81564b29 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.591902 Aug 01 14:18:34.378714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 528/1044] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:18:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:18:34.379158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a36a5e3-39e5-4aca-a775-5d024436c456 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.156757 Aug 01 14:18:34.379847 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 517/1045] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:34 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:18:34.389165 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6f79c00e-dd02-4906-919d-2367162868f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:34.389771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6f79c00e-dd02-4906-919d-2367162868f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:34.448626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6f79c00e-dd02-4906-919d-2367162868f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:34.456936 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6f79c00e-dd02-4906-919d-2367162868f0 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1237 microversion: 2.1 time: 0.071260 Aug 01 14:18:34.457326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 529/1046] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:34 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:35.008589 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b93a0459-6ad1-40a5-9468-4434f214aad1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:35.010736 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b93a0459-6ad1-40a5-9468-4434f214aad1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:35.017917 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b93a0459-6ad1-40a5-9468-4434f214aad1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.018370 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b93a0459-6ad1-40a5-9468-4434f214aad1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.019332 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b93a0459-6ad1-40a5-9468-4434f214aad1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.019932 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b93a0459-6ad1-40a5-9468-4434f214aad1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.052755 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b93a0459-6ad1-40a5-9468-4434f214aad1 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048129 Aug 01 14:18:35.053326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 518/1047] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:18:35 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:18:35.114424 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-aa061661-bb14-414c-9cea-c171528c577a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:35.114943 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-aa061661-bb14-414c-9cea-c171528c577a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:35.121440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aa061661-bb14-414c-9cea-c171528c577a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.121890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aa061661-bb14-414c-9cea-c171528c577a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.122654 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aa061661-bb14-414c-9cea-c171528c577a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.123120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-aa061661-bb14-414c-9cea-c171528c577a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.147562 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-aa061661-bb14-414c-9cea-c171528c577a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:18:35.220170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-aa061661-bb14-414c-9cea-c171528c577a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 204 len: 0 microversion: 2.1 time: 0.109237 Aug 01 14:18:35.220883 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 530/1048] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:18:35 2022] DELETE /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:18:35.229025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-42c71d92-dc33-44e2-bada-81b917193f97 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:35.229643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-42c71d92-dc33-44e2-bada-81b917193f97 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:35.235597 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42c71d92-dc33-44e2-bada-81b917193f97 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.236046 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42c71d92-dc33-44e2-bada-81b917193f97 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.236839 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42c71d92-dc33-44e2-bada-81b917193f97 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.237276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-42c71d92-dc33-44e2-bada-81b917193f97 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.374055 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-42c71d92-dc33-44e2-bada-81b917193f97 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:35.377606 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:35.382712 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-42c71d92-dc33-44e2-bada-81b917193f97 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1683 microversion: 2.1 time: 0.157566 Aug 01 14:18:35.383282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 519/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:35 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:35.403399 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:35.404301 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:35.410450 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.410894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.411715 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.412217 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.478731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a7853a5c-3ab0-47ca-8ed4-a5145df3cca8 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:35.479484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a7853a5c-3ab0-47ca-8ed4-a5145df3cca8 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:35.486603 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a7853a5c-3ab0-47ca-8ed4-a5145df3cca8 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.487158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a7853a5c-3ab0-47ca-8ed4-a5145df3cca8 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.487938 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a7853a5c-3ab0-47ca-8ed4-a5145df3cca8 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:35.488379 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a7853a5c-3ab0-47ca-8ed4-a5145df3cca8 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:35.546608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:35.551684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a7853a5c-3ab0-47ca-8ed4-a5145df3cca8 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:35.555016 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:35.556536 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:35.558263 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3982bdba-3bdf-483e-a87f-afab13b65d19 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.159855 Aug 01 14:18:35.558826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 531/1050] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:35 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:35.559929 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a7853a5c-3ab0-47ca-8ed4-a5145df3cca8 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1297 microversion: 2.1 time: 0.085943 Aug 01 14:18:35.560524 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 520/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:35 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:36.404899 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c034a8f5-b6ed-459b-8bed-d199ceb158a5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:36.405517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c034a8f5-b6ed-459b-8bed-d199ceb158a5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:36.412109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c034a8f5-b6ed-459b-8bed-d199ceb158a5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.412589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c034a8f5-b6ed-459b-8bed-d199ceb158a5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.413354 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c034a8f5-b6ed-459b-8bed-d199ceb158a5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.413788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c034a8f5-b6ed-459b-8bed-d199ceb158a5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.550879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c034a8f5-b6ed-459b-8bed-d199ceb158a5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:36.558416 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c034a8f5-b6ed-459b-8bed-d199ceb158a5 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1683 microversion: 2.1 time: 0.157959 Aug 01 14:18:36.558983 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 532/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:36 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:36.581614 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b7b44da4-76af-4ce6-8726-ba9601e32b39 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:36.582227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b7b44da4-76af-4ce6-8726-ba9601e32b39 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:36.582539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:36.583156 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:36.589620 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7b44da4-76af-4ce6-8726-ba9601e32b39 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.589741 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.589972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7b44da4-76af-4ce6-8726-ba9601e32b39 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.590083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.590882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7b44da4-76af-4ce6-8726-ba9601e32b39 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.590999 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:36.591174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b7b44da4-76af-4ce6-8726-ba9601e32b39 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.591285 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:36.658275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b7b44da4-76af-4ce6-8726-ba9601e32b39 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:36.665781 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b7b44da4-76af-4ce6-8726-ba9601e32b39 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1297 microversion: 2.1 time: 0.087976 Aug 01 14:18:36.666990 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 521/1053] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:36 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1297 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:36.721452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:36.729534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:36.731106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:36.732254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-92e58a04-0024-42dd-ab14-4d0c2d928646 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.153318 Aug 01 14:18:36.732839 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 533/1054] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:36 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:18:37.579610 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-71ad7e56-dc2b-4148-9a2c-66c8989ab122 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:37.580225 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-71ad7e56-dc2b-4148-9a2c-66c8989ab122 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:37.590940 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-71ad7e56-dc2b-4148-9a2c-66c8989ab122 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:37.591484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-71ad7e56-dc2b-4148-9a2c-66c8989ab122 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:37.592158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-71ad7e56-dc2b-4148-9a2c-66c8989ab122 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:37.592607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-71ad7e56-dc2b-4148-9a2c-66c8989ab122 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:37.687290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d69ec646-e868-4165-922b-1d956acd8a99 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:37.688366 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d69ec646-e868-4165-922b-1d956acd8a99 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:37.694956 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d69ec646-e868-4165-922b-1d956acd8a99 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:37.695567 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d69ec646-e868-4165-922b-1d956acd8a99 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:37.696424 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d69ec646-e868-4165-922b-1d956acd8a99 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:37.697150 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d69ec646-e868-4165-922b-1d956acd8a99 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:37.840949 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d69ec646-e868-4165-922b-1d956acd8a99 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:37.848581 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d69ec646-e868-4165-922b-1d956acd8a99 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.165270 Aug 01 14:18:37.849291 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 534/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:37 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:37.855241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:37.856170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:37.868627 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:37.870510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:37.872673 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:37.873360 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:37.906621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-71ad7e56-dc2b-4148-9a2c-66c8989ab122 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:37.915257 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-71ad7e56-dc2b-4148-9a2c-66c8989ab122 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1683 microversion: 2.1 time: 0.339472 Aug 01 14:18:37.916148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 522/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:37 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1683 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:38.017624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:38.026985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:38.028693 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:38.029848 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0f2d6151-77f2-4343-af8f-9ae808c3a11a tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.179418 Aug 01 14:18:38.030409 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 535/1057] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:37 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:38.219899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6d18d81b-1d5d-4be3-be01-fea4dc587d83 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:38.220452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6d18d81b-1d5d-4be3-be01-fea4dc587d83 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:38.226459 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d18d81b-1d5d-4be3-be01-fea4dc587d83 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.226905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d18d81b-1d5d-4be3-be01-fea4dc587d83 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.227666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d18d81b-1d5d-4be3-be01-fea4dc587d83 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.228110 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d18d81b-1d5d-4be3-be01-fea4dc587d83 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.251902 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-6d18d81b-1d5d-4be3-be01-fea4dc587d83 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lazy-loading 'flavor' on Instance uuid be944f58-3d1b-43af-bd53-5d0f0c17f6a7 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:18:38.325371 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6d18d81b-1d5d-4be3-be01-fea4dc587d83 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "POST /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7/action" status: 202 len: 0 microversion: 2.1 time: 0.109230 Aug 01 14:18:38.326137 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 523/1058] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:18:38 2022] POST /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:18:38.338214 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c9d4089e-25bc-4502-a58b-54202bb3803a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:38.341995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c9d4089e-25bc-4502-a58b-54202bb3803a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:38.350495 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c9d4089e-25bc-4502-a58b-54202bb3803a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.350953 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c9d4089e-25bc-4502-a58b-54202bb3803a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.351736 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c9d4089e-25bc-4502-a58b-54202bb3803a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.352173 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c9d4089e-25bc-4502-a58b-54202bb3803a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.372436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:38.500295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c9d4089e-25bc-4502-a58b-54202bb3803a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:38.508678 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c9d4089e-25bc-4502-a58b-54202bb3803a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.177449 Aug 01 14:18:38.509260 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 536/1059] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:38 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:38.748995 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-7b59a664-74a1-4643-b553-7f7f06ffd709 req-81b02a8f-4ef3-4bdb-acc2-5a9b8fce9d0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a8a080-a34d-4ba9-8131-f502e8a54ff4", "tag": "bf39acbe-27ee-4f84-a849-b6d623845fab"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:38.760190 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-7b59a664-74a1-4643-b553-7f7f06ffd709 req-81b02a8f-4ef3-4bdb-acc2-5a9b8fce9d0e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.760695 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-7b59a664-74a1-4643-b553-7f7f06ffd709 req-81b02a8f-4ef3-4bdb-acc2-5a9b8fce9d0e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.771823 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-7b59a664-74a1-4643-b553-7f7f06ffd709 req-81b02a8f-4ef3-4bdb-acc2-5a9b8fce9d0e service nova] Creating event network-changed:bf39acbe-27ee-4f84-a849-b6d623845fab for instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 on hv-cinder-84713 Aug 01 14:18:38.777022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-7b59a664-74a1-4643-b553-7f7f06ffd709 req-81b02a8f-4ef3-4bdb-acc2-5a9b8fce9d0e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032327 Aug 01 14:18:38.777630 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 524/1060] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:38.870702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3111d064-9c54-432d-9410-9f2f9f5794ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:38.871643 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3111d064-9c54-432d-9410-9f2f9f5794ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:38.878620 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3111d064-9c54-432d-9410-9f2f9f5794ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.879282 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3111d064-9c54-432d-9410-9f2f9f5794ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.880254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3111d064-9c54-432d-9410-9f2f9f5794ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.880714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3111d064-9c54-432d-9410-9f2f9f5794ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.937851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-81be9906-947f-42d7-83b7-e98af86c1070 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:38.939080 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-81be9906-947f-42d7-83b7-e98af86c1070 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:38.949171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-81be9906-947f-42d7-83b7-e98af86c1070 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.949763 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-81be9906-947f-42d7-83b7-e98af86c1070 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:38.950660 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-81be9906-947f-42d7-83b7-e98af86c1070 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:38.951231 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-81be9906-947f-42d7-83b7-e98af86c1070 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:39.096386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3111d064-9c54-432d-9410-9f2f9f5794ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:39.106109 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3111d064-9c54-432d-9410-9f2f9f5794ed tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.238722 Aug 01 14:18:39.106699 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 537/1061] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:38 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:39.112316 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:39.113231 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:39.120961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:39.121991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:39.123309 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:39.124277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:39.273155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:39.281980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:39.284522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:39.285750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f3e6502c-8a10-4b87-ba1b-c5de50e48dc2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.176951 Aug 01 14:18:39.286808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 538/1062] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:39 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:39.324568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-81be9906-947f-42d7-83b7-e98af86c1070 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:39.333081 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-81be9906-947f-42d7-83b7-e98af86c1070 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 200 len: 1615 microversion: 2.1 time: 0.399280 Aug 01 14:18:39.340990 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 525/1063] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:38 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 1615 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:39.530676 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ba078888-f24f-4938-88d7-af84ebacf523 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:39.531320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ba078888-f24f-4938-88d7-af84ebacf523 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:39.541780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba078888-f24f-4938-88d7-af84ebacf523 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:39.542410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba078888-f24f-4938-88d7-af84ebacf523 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:39.545526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba078888-f24f-4938-88d7-af84ebacf523 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:39.545526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba078888-f24f-4938-88d7-af84ebacf523 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:39.674195 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ba078888-f24f-4938-88d7-af84ebacf523 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:39.682436 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ba078888-f24f-4938-88d7-af84ebacf523 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.155386 Aug 01 14:18:39.683066 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 539/1064] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:39 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:40.129117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c41910d5-7411-4ab0-801f-0dba81a6a4ae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:40.129742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c41910d5-7411-4ab0-801f-0dba81a6a4ae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:40.136396 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c41910d5-7411-4ab0-801f-0dba81a6a4ae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.136882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c41910d5-7411-4ab0-801f-0dba81a6a4ae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.137652 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c41910d5-7411-4ab0-801f-0dba81a6a4ae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.138091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c41910d5-7411-4ab0-801f-0dba81a6a4ae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.265393 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c41910d5-7411-4ab0-801f-0dba81a6a4ae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:40.272729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c41910d5-7411-4ab0-801f-0dba81a6a4ae tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.147504 Aug 01 14:18:40.273302 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 526/1065] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:40 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:40.307070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:40.307681 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:40.314158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.314606 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.315366 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.315802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.355679 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:40.356229 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:40.362191 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.362637 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.363410 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.363836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.376900 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f HTTP/1.1 Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:18:40.378534 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:18:40.380090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'a0a6965a-e41a-44e6-8317-3a420f00e98f'} Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:18:40.380988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:18:40.382403 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:18:40.383887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:18:40.383887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8d16f609-2ab6-4283-b86a-7c1d6e79d625 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 404 len: 111 microversion: 2.1 time: 0.028725 Aug 01 14:18:40.383887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 527/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:40 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:18:40.388531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6a0562a3-8913-499d-81d0-ed3407e1cd5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '.version_select at 0x7f4462ee21f0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:40.407468 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6a0562a3-8913-499d-81d0-ed3407e1cd5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-570911533" status: 202 len: 0 microversion: 2.1 time: 0.022360 Aug 01 14:18:40.408040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 528/1067] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 14:18:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-570911533 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:18:40.450197 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:40.459890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:40.460613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:40.462015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6cf8732f-3d2d-4945-9a98-5cee8c1ffef2 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.158874 Aug 01 14:18:40.476921 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 540/1068] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:40 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:40.703787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a213b6a-e232-4cb0-8a97-0099ac297e95 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:40.704431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a213b6a-e232-4cb0-8a97-0099ac297e95 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:40.710481 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a213b6a-e232-4cb0-8a97-0099ac297e95 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.710926 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a213b6a-e232-4cb0-8a97-0099ac297e95 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.711689 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a213b6a-e232-4cb0-8a97-0099ac297e95 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.712120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a213b6a-e232-4cb0-8a97-0099ac297e95 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.805778 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-48b589ec-db2b-43a8-b0ed-d9c32c6c03e2 req-b0726da7-3c74-4203-8206-0a6ecb8b053f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a6965a-e41a-44e6-8317-3a420f00e98f", "name": "network-vif-deleted", "tag": "ebafe7aa-c8e3-4a0e-9296-a84b979fd578"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:40.822977 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-48b589ec-db2b-43a8-b0ed-d9c32c6c03e2 req-b0726da7-3c74-4203-8206-0a6ecb8b053f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:40.823426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-48b589ec-db2b-43a8-b0ed-d9c32c6c03e2 req-b0726da7-3c74-4203-8206-0a6ecb8b053f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:40.836176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-48b589ec-db2b-43a8-b0ed-d9c32c6c03e2 req-b0726da7-3c74-4203-8206-0a6ecb8b053f service nova] Creating event network-vif-deleted:ebafe7aa-c8e3-4a0e-9296-a84b979fd578 for instance a0a6965a-e41a-44e6-8317-3a420f00e98f on hv-cinder-84713 Aug 01 14:18:40.841706 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-48b589ec-db2b-43a8-b0ed-d9c32c6c03e2 req-b0726da7-3c74-4203-8206-0a6ecb8b053f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039678 Aug 01 14:18:40.842285 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 541/1069] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:40.863642 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a213b6a-e232-4cb0-8a97-0099ac297e95 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:40.871260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a213b6a-e232-4cb0-8a97-0099ac297e95 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.171550 Aug 01 14:18:40.871830 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 529/1070] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:40 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:41.027409 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-959f173c-2cc5-45b6-b2d1-1bbd9cd0fc4d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: .version_select at 0x7f4462e31a60>, body: {"keypair": {"name": "tempest-keypair-1745021518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHE64QjEQnSPkCIx2D/uqXTruLCczW6TNR/Isu1C3FfoWpsNdkOeW5kkVyQyViGDISprTLKYkVZfFjITtOb4fgrNUEh7J73N9Q/qBcoqNWL4FJ3iPptsLdMPYH2o0imWGg=="}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:41.043153 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-959f173c-2cc5-45b6-b2d1-1bbd9cd0fc4d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for project a3203f080a05422e83090a1f0a31d1a9. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:18:41.046939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-959f173c-2cc5-45b6-b2d1-1bbd9cd0fc4d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for user ca3cd1c2aec94b43aff0034b812a069d and project a3203f080a05422e83090a1f0a31d1a9. Resources: {'key_pairs'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:18:41.061881 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:41.070407 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-959f173c-2cc5-45b6-b2d1-1bbd9cd0fc4d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047793 Aug 01 14:18:41.071005 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 542/1071] 10.222.0.48 () {60 vars in 1159 bytes} [Mon Aug 1 14:18:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:41.293597 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-63962a87-2006-455a-86d6-6a7f6f47615c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:41.294382 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-63962a87-2006-455a-86d6-6a7f6f47615c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:41.301178 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63962a87-2006-455a-86d6-6a7f6f47615c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:41.301412 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63962a87-2006-455a-86d6-6a7f6f47615c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:41.302184 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63962a87-2006-455a-86d6-6a7f6f47615c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:41.302625 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63962a87-2006-455a-86d6-6a7f6f47615c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:41.442984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-63962a87-2006-455a-86d6-6a7f6f47615c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:41.451177 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-63962a87-2006-455a-86d6-6a7f6f47615c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.161455 Aug 01 14:18:41.451753 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 530/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:41 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:41.487395 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:41.488124 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:41.496519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:41.496967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:41.497737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:41.498168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:41.637672 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:41.645994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:41.647510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:41.648829 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5a9c52a8-532a-4394-ae75-689799f8cfd0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.166365 Aug 01 14:18:41.649414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 543/1073] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:41 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:41.892863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b16964a6-d31c-4396-acfd-dad679689296 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:41.893494 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b16964a6-d31c-4396-acfd-dad679689296 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:41.899346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b16964a6-d31c-4396-acfd-dad679689296 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:41.900955 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b16964a6-d31c-4396-acfd-dad679689296 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:41.902133 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b16964a6-d31c-4396-acfd-dad679689296 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:41.902420 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b16964a6-d31c-4396-acfd-dad679689296 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:42.100273 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b16964a6-d31c-4396-acfd-dad679689296 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:42.107982 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b16964a6-d31c-4396-acfd-dad679689296 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.219482 Aug 01 14:18:42.108591 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 531/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:41 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:42.472878 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a10a89d3-1f98-40b4-af34-39c05bbad630 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:42.473500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a10a89d3-1f98-40b4-af34-39c05bbad630 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:42.480801 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a10a89d3-1f98-40b4-af34-39c05bbad630 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:42.481254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a10a89d3-1f98-40b4-af34-39c05bbad630 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:42.482032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a10a89d3-1f98-40b4-af34-39c05bbad630 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:42.482470 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a10a89d3-1f98-40b4-af34-39c05bbad630 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:42.484520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-305087994", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "953311ac-9b59-429f-b3be-74acb6dca2d9"}], "security_groups": [{"name": "tempest-securitygroup--1881894034"}], "key_name": "tempest-keypair-1745021518", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:42.624256 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a10a89d3-1f98-40b4-af34-39c05bbad630 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:42.628176 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] validate_networks() for [('953311ac-9b59-429f-b3be-74acb6dca2d9', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:18:42.631802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a10a89d3-1f98-40b4-af34-39c05bbad630 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.162734 Aug 01 14:18:42.637541 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 544/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:42 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:42.672959 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:42.674031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:42.680009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:42.680449 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:42.681299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:42.681727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:42.815284 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:42.826087 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:42.827646 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:42.828852 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7af56041-ce9e-4121-9be8-6998a4b2fbe4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1744 microversion: 2.20 time: 0.159865 Aug 01 14:18:42.830084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 545/1076] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:42 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:18:43.128859 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b24f31b2-3ce7-4bcc-818c-269d20242b2d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:43.129506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b24f31b2-3ce7-4bcc-818c-269d20242b2d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:43.136089 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b24f31b2-3ce7-4bcc-818c-269d20242b2d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.136556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b24f31b2-3ce7-4bcc-818c-269d20242b2d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.137314 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b24f31b2-3ce7-4bcc-818c-269d20242b2d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.137745 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b24f31b2-3ce7-4bcc-818c-269d20242b2d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.158211 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:18:43.158638 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:18:43.159119 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:18:43.159530 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:18:43.159948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:18:43.168968 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.169448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.170276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.170711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.187993 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for project a3203f080a05422e83090a1f0a31d1a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:18:43.192262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Getting quotas for user ca3cd1c2aec94b43aff0034b812a069d and project a3203f080a05422e83090a1f0a31d1a9. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:18:43.203907 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:18:43.206184 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:18:43.253399 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6a892736-0a2c-40c3-b41f-fb7d5e8160d9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.773329 Aug 01 14:18:43.254218 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 532/1077] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:18:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 01 14:18:43.265115 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3ebe8a83-ffe7-49b0-a8b2-052b118e5395 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:43.265720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3ebe8a83-ffe7-49b0-a8b2-052b118e5395 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:43.275472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b24f31b2-3ce7-4bcc-818c-269d20242b2d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:43.283515 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b24f31b2-3ce7-4bcc-818c-269d20242b2d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.158515 Aug 01 14:18:43.284399 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 546/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:43 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:43.324832 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3ebe8a83-ffe7-49b0-a8b2-052b118e5395 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:43.331667 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3ebe8a83-ffe7-49b0-a8b2-052b118e5395 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1241 microversion: 2.1 time: 0.070232 Aug 01 14:18:43.332240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 533/1079] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:43 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:43.653818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e57ebe51-ccf2-4caf-bfaf-4821019cbfd4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:43.654444 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e57ebe51-ccf2-4caf-bfaf-4821019cbfd4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:43.661792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e57ebe51-ccf2-4caf-bfaf-4821019cbfd4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.662257 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e57ebe51-ccf2-4caf-bfaf-4821019cbfd4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.663355 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e57ebe51-ccf2-4caf-bfaf-4821019cbfd4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.663838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e57ebe51-ccf2-4caf-bfaf-4821019cbfd4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.799981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e57ebe51-ccf2-4caf-bfaf-4821019cbfd4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:43.808156 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e57ebe51-ccf2-4caf-bfaf-4821019cbfd4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.159445 Aug 01 14:18:43.808754 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 547/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:43 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:43.852783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:43.853428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:43.860035 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.860691 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.861465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:43.862090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:43.990557 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:43.998978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:44.000440 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:44.001621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b3230a83-6c88-4ced-b4b0-0fc9da8850ab tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1744 microversion: 2.20 time: 0.152771 Aug 01 14:18:44.002186 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 534/1081] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:43 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1744 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:44.306459 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9ebfd35f-117d-4910-baa0-2758cf28a55d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:44.307011 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9ebfd35f-117d-4910-baa0-2758cf28a55d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:44.308991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:44.314801 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9ebfd35f-117d-4910-baa0-2758cf28a55d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:44.315241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9ebfd35f-117d-4910-baa0-2758cf28a55d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:44.316024 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9ebfd35f-117d-4910-baa0-2758cf28a55d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:44.316459 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9ebfd35f-117d-4910-baa0-2758cf28a55d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:44.351297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-350ba938-2a9b-49f1-b7c4-b00d4955176e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:44.351905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-350ba938-2a9b-49f1-b7c4-b00d4955176e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:44.360392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-350ba938-2a9b-49f1-b7c4-b00d4955176e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:44.360894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-350ba938-2a9b-49f1-b7c4-b00d4955176e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:44.361720 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-350ba938-2a9b-49f1-b7c4-b00d4955176e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:44.362157 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-350ba938-2a9b-49f1-b7c4-b00d4955176e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:44.444821 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-350ba938-2a9b-49f1-b7c4-b00d4955176e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:44.453285 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-350ba938-2a9b-49f1-b7c4-b00d4955176e tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1299 microversion: 2.1 time: 0.105520 Aug 01 14:18:44.456522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 535/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:44 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:44.465437 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9ebfd35f-117d-4910-baa0-2758cf28a55d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:44.474069 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9ebfd35f-117d-4910-baa0-2758cf28a55d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.171728 Aug 01 14:18:44.474647 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 548/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:44 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:44.829552 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f67650f7-8b6a-4d97-ae0d-71466f070d2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:44.830969 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f67650f7-8b6a-4d97-ae0d-71466f070d2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:44.837907 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f67650f7-8b6a-4d97-ae0d-71466f070d2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:44.838385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f67650f7-8b6a-4d97-ae0d-71466f070d2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:44.839202 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f67650f7-8b6a-4d97-ae0d-71466f070d2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:44.839643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f67650f7-8b6a-4d97-ae0d-71466f070d2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.026354 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:45.027018 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:45.034253 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.034831 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.035893 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.036495 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.047542 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f67650f7-8b6a-4d97-ae0d-71466f070d2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:45.060767 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f67650f7-8b6a-4d97-ae0d-71466f070d2d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.234940 Aug 01 14:18:45.061750 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 536/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:44 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:45.186567 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:45.195842 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:45.198023 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:45.199650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7c4d2a24-0539-44f5-9eb2-79e01a55ee07 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1744 microversion: 2.20 time: 0.178886 Aug 01 14:18:45.200367 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 549/1085] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:45 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:45.475279 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1d34b051-f823-4231-a184-e43172a4abf0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:45.475898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1d34b051-f823-4231-a184-e43172a4abf0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:45.482431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d34b051-f823-4231-a184-e43172a4abf0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.482789 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d34b051-f823-4231-a184-e43172a4abf0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.483613 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d34b051-f823-4231-a184-e43172a4abf0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.484051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d34b051-f823-4231-a184-e43172a4abf0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.496510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-807f9d48-b352-4ee0-9b68-fe18cf42034d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:45.497173 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-807f9d48-b352-4ee0-9b68-fe18cf42034d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:45.503991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-807f9d48-b352-4ee0-9b68-fe18cf42034d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.504721 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-807f9d48-b352-4ee0-9b68-fe18cf42034d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.505497 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-807f9d48-b352-4ee0-9b68-fe18cf42034d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.505936 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-807f9d48-b352-4ee0-9b68-fe18cf42034d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.642800 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-807f9d48-b352-4ee0-9b68-fe18cf42034d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:45.650944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-807f9d48-b352-4ee0-9b68-fe18cf42034d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.159637 Aug 01 14:18:45.651513 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 550/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:45 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:45.736149 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1d34b051-f823-4231-a184-e43172a4abf0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:45.743786 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1d34b051-f823-4231-a184-e43172a4abf0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.272308 Aug 01 14:18:45.744367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 537/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:45 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:45.881730 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-b2c955cb-a8e7-4fe9-9032-65a41b90f948 req-04ead330-012b-4206-9bc8-19ef8ff2b06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3639d3f-a4f5-49b1-bd17-26c44c0113ba", "tag": "ad876c77-136b-4537-bd94-96619059c312"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:45.891718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-b2c955cb-a8e7-4fe9-9032-65a41b90f948 req-04ead330-012b-4206-9bc8-19ef8ff2b06f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:45.892177 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-b2c955cb-a8e7-4fe9-9032-65a41b90f948 req-04ead330-012b-4206-9bc8-19ef8ff2b06f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:45.904042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-b2c955cb-a8e7-4fe9-9032-65a41b90f948 req-04ead330-012b-4206-9bc8-19ef8ff2b06f service nova] Creating event network-changed:ad876c77-136b-4537-bd94-96619059c312 for instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba on hv-cinder-84713 Aug 01 14:18:45.908851 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-b2c955cb-a8e7-4fe9-9032-65a41b90f948 req-04ead330-012b-4206-9bc8-19ef8ff2b06f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030689 Aug 01 14:18:45.909448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 551/1088] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:46.084952 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6879dfaa-2e16-48fb-b0bc-85e382378658 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:46.085572 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6879dfaa-2e16-48fb-b0bc-85e382378658 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:46.092830 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6879dfaa-2e16-48fb-b0bc-85e382378658 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.093539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6879dfaa-2e16-48fb-b0bc-85e382378658 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.094543 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6879dfaa-2e16-48fb-b0bc-85e382378658 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.095146 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6879dfaa-2e16-48fb-b0bc-85e382378658 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.113973 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:46.224773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:46.225686 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:46.232667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.233195 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.234032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.234540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.339915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6879dfaa-2e16-48fb-b0bc-85e382378658 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:46.347643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6879dfaa-2e16-48fb-b0bc-85e382378658 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.266637 Aug 01 14:18:46.348218 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 538/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:46 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:46.367971 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:46.376396 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:46.377951 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:46.379181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4f5c11b8-bff6-4013-90fb-bafa66d116ec tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1744 microversion: 2.20 time: 0.159255 Aug 01 14:18:46.379742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 552/1090] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:46 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:18:46.673193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f0c2a24c-4937-4545-9754-f5bd6bd2621f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:46.673826 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f0c2a24c-4937-4545-9754-f5bd6bd2621f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:46.679807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0c2a24c-4937-4545-9754-f5bd6bd2621f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.680260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0c2a24c-4937-4545-9754-f5bd6bd2621f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.681688 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0c2a24c-4937-4545-9754-f5bd6bd2621f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.682158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0c2a24c-4937-4545-9754-f5bd6bd2621f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.764615 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-29f82bdc-b4b0-4439-97ee-af066b1c1b9f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:46.765353 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-29f82bdc-b4b0-4439-97ee-af066b1c1b9f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:46.771398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29f82bdc-b4b0-4439-97ee-af066b1c1b9f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.771854 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29f82bdc-b4b0-4439-97ee-af066b1c1b9f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.772653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29f82bdc-b4b0-4439-97ee-af066b1c1b9f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:46.773132 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29f82bdc-b4b0-4439-97ee-af066b1c1b9f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:46.889630 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f0c2a24c-4937-4545-9754-f5bd6bd2621f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:46.897483 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f0c2a24c-4937-4545-9754-f5bd6bd2621f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.228167 Aug 01 14:18:46.898201 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 539/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:46 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:46.908206 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-29f82bdc-b4b0-4439-97ee-af066b1c1b9f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:46.916521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-29f82bdc-b4b0-4439-97ee-af066b1c1b9f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.155927 Aug 01 14:18:46.917111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 553/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:46 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:47.368668 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-99e71460-d596-49c2-b417-d29d6ac170f6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:47.369807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-99e71460-d596-49c2-b417-d29d6ac170f6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:47.376264 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99e71460-d596-49c2-b417-d29d6ac170f6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.376744 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99e71460-d596-49c2-b417-d29d6ac170f6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.377505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99e71460-d596-49c2-b417-d29d6ac170f6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.377937 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99e71460-d596-49c2-b417-d29d6ac170f6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.402471 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:47.403111 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:47.409592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.410051 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.410826 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.411270 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.525672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-99e71460-d596-49c2-b417-d29d6ac170f6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:47.534013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-99e71460-d596-49c2-b417-d29d6ac170f6 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.169178 Aug 01 14:18:47.534612 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 540/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:47 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:47.554964 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:47.565440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:47.568290 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:47.570100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0093e2ab-2c53-451a-9cdc-da11885274e7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1744 microversion: 2.20 time: 0.171352 Aug 01 14:18:47.570938 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 554/1094] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:47 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:18:47.636878 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-fa6cf820-c06a-4233-b1e6-6d1a4890d4ee req-a05c14fe-32dd-4ce2-ac45-c67c1b7c5549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a8a080-a34d-4ba9-8131-f502e8a54ff4", "name": "network-vif-plugged", "status": "completed", "tag": "bf39acbe-27ee-4f84-a849-b6d623845fab"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:47.646781 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fa6cf820-c06a-4233-b1e6-6d1a4890d4ee req-a05c14fe-32dd-4ce2-ac45-c67c1b7c5549 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.647228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fa6cf820-c06a-4233-b1e6-6d1a4890d4ee req-a05c14fe-32dd-4ce2-ac45-c67c1b7c5549 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.658666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-fa6cf820-c06a-4233-b1e6-6d1a4890d4ee req-a05c14fe-32dd-4ce2-ac45-c67c1b7c5549 service nova] Creating event network-vif-plugged:bf39acbe-27ee-4f84-a849-b6d623845fab for instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 on hv-cinder-84713 Aug 01 14:18:47.663600 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-fa6cf820-c06a-4233-b1e6-6d1a4890d4ee req-a05c14fe-32dd-4ce2-ac45-c67c1b7c5549 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030749 Aug 01 14:18:47.664201 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 541/1095] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:47.919725 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7ceb5e9b-3f81-42da-a009-c484f833f2ec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:47.920344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7ceb5e9b-3f81-42da-a009-c484f833f2ec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:47.926490 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ceb5e9b-3f81-42da-a009-c484f833f2ec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.926939 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ceb5e9b-3f81-42da-a009-c484f833f2ec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.927701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ceb5e9b-3f81-42da-a009-c484f833f2ec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.928141 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ceb5e9b-3f81-42da-a009-c484f833f2ec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.937417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2321ace-326a-422e-a444-10a70007db39 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:47.938282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e2321ace-326a-422e-a444-10a70007db39 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:47.944910 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2321ace-326a-422e-a444-10a70007db39 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.945365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2321ace-326a-422e-a444-10a70007db39 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.946170 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2321ace-326a-422e-a444-10a70007db39 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:47.947110 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2321ace-326a-422e-a444-10a70007db39 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:47.947236 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:48.070574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7ceb5e9b-3f81-42da-a009-c484f833f2ec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:48.078692 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7ceb5e9b-3f81-42da-a009-c484f833f2ec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.163418 Aug 01 14:18:48.079265 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 555/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:47 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:48.084913 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e2321ace-326a-422e-a444-10a70007db39 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:48.092978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e2321ace-326a-422e-a444-10a70007db39 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.159863 Aug 01 14:18:48.093531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 542/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:47 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:48.554701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-09df2953-ea63-4461-b3d0-982d2156ae32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:48.555321 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-09df2953-ea63-4461-b3d0-982d2156ae32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:48.562405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09df2953-ea63-4461-b3d0-982d2156ae32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:48.562857 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09df2953-ea63-4461-b3d0-982d2156ae32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:48.563616 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09df2953-ea63-4461-b3d0-982d2156ae32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:48.564055 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09df2953-ea63-4461-b3d0-982d2156ae32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:48.605514 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:48.606328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:48.613039 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:48.613494 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:48.614276 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:48.614717 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:48.698042 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-09df2953-ea63-4461-b3d0-982d2156ae32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:48.705580 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-09df2953-ea63-4461-b3d0-982d2156ae32 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.154728 Aug 01 14:18:48.706184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 556/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:48 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:48.748760 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:48.756734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:48.758248 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:48.759407 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5edc21a5-41a6-46b4-8ea6-93e9d30949ac tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1744 microversion: 2.20 time: 0.159310 Aug 01 14:18:48.759976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 543/1099] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:48 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:49.100348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e07da642-f1a2-4213-93cc-d6ef8fa0d9de tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:49.100901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e07da642-f1a2-4213-93cc-d6ef8fa0d9de tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:49.108764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e07da642-f1a2-4213-93cc-d6ef8fa0d9de tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.108764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e07da642-f1a2-4213-93cc-d6ef8fa0d9de tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.108764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e07da642-f1a2-4213-93cc-d6ef8fa0d9de tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.109185 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e07da642-f1a2-4213-93cc-d6ef8fa0d9de tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.114099 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-76d278c0-0024-4910-a521-2c0125e1319d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:49.114840 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-76d278c0-0024-4910-a521-2c0125e1319d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:49.120919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76d278c0-0024-4910-a521-2c0125e1319d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.121365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76d278c0-0024-4910-a521-2c0125e1319d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.122148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76d278c0-0024-4910-a521-2c0125e1319d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.122563 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76d278c0-0024-4910-a521-2c0125e1319d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.247128 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e07da642-f1a2-4213-93cc-d6ef8fa0d9de tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:49.255130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e07da642-f1a2-4213-93cc-d6ef8fa0d9de tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.158646 Aug 01 14:18:49.255917 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 557/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:49 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:49.504419 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-76d278c0-0024-4910-a521-2c0125e1319d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:49.514013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-76d278c0-0024-4910-a521-2c0125e1319d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.403660 Aug 01 14:18:49.514809 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 544/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:49 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:49.684219 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-f7c6e339-1914-4b79-a8fc-574cacab2fc0 req-e3e15706-f2c7-4012-ac5e-11bba92bd6a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900b90f4-dd21-4df9-a880-5760f2c62ae5", "name": "network-vif-plugged", "status": "completed", "tag": "27822eab-07c3-4ba4-b4e4-e82eaa97336f"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:49.696364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-f7c6e339-1914-4b79-a8fc-574cacab2fc0 req-e3e15706-f2c7-4012-ac5e-11bba92bd6a0 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.697773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-f7c6e339-1914-4b79-a8fc-574cacab2fc0 req-e3e15706-f2c7-4012-ac5e-11bba92bd6a0 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.711080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-f7c6e339-1914-4b79-a8fc-574cacab2fc0 req-e3e15706-f2c7-4012-ac5e-11bba92bd6a0 service nova] Creating event network-vif-plugged:27822eab-07c3-4ba4-b4e4-e82eaa97336f for instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 on hv-cinder-84713 Aug 01 14:18:49.716905 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-f7c6e339-1914-4b79-a8fc-574cacab2fc0 req-e3e15706-f2c7-4012-ac5e-11bba92bd6a0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038654 Aug 01 14:18:49.717706 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 558/1102] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:49.727899 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-21b9e4c9-aa12-4d73-8067-dc28b5eb8516 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:49.728894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-21b9e4c9-aa12-4d73-8067-dc28b5eb8516 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:49.735128 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:49.737044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21b9e4c9-aa12-4d73-8067-dc28b5eb8516 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.737715 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21b9e4c9-aa12-4d73-8067-dc28b5eb8516 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.739004 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21b9e4c9-aa12-4d73-8067-dc28b5eb8516 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.739786 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21b9e4c9-aa12-4d73-8067-dc28b5eb8516 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.785350 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:49.786060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:49.793552 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.794071 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.794887 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:49.795325 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:49.954731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:49.964204 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:49.966056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:49.967512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0909b9b4-e50a-427e-84c5-a506080a4d1e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.187726 Aug 01 14:18:49.968577 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 559/1103] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:49 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:18:50.042402 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-21b9e4c9-aa12-4d73-8067-dc28b5eb8516 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:50.064459 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-21b9e4c9-aa12-4d73-8067-dc28b5eb8516 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.341558 Aug 01 14:18:50.066717 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 545/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:49 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:50.275734 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d472e57e-41b9-4037-88c8-996231505f31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:50.276658 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d472e57e-41b9-4037-88c8-996231505f31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:50.287733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d472e57e-41b9-4037-88c8-996231505f31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:50.288279 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d472e57e-41b9-4037-88c8-996231505f31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:50.289157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d472e57e-41b9-4037-88c8-996231505f31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:50.289672 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d472e57e-41b9-4037-88c8-996231505f31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:50.448743 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d472e57e-41b9-4037-88c8-996231505f31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:50.460739 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d472e57e-41b9-4037-88c8-996231505f31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.188565 Aug 01 14:18:50.469121 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 560/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:50 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:50.536753 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e367b7f2-e742-4b1b-8447-ca4003f688a7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:50.537724 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e367b7f2-e742-4b1b-8447-ca4003f688a7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:50.545029 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e367b7f2-e742-4b1b-8447-ca4003f688a7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:50.545742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e367b7f2-e742-4b1b-8447-ca4003f688a7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:50.546708 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e367b7f2-e742-4b1b-8447-ca4003f688a7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:50.547305 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e367b7f2-e742-4b1b-8447-ca4003f688a7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:50.714297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e367b7f2-e742-4b1b-8447-ca4003f688a7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:50.723221 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e367b7f2-e742-4b1b-8447-ca4003f688a7 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.191302 Aug 01 14:18:50.736298 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 546/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:50 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:50.991346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:50.992093 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:51.000652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.001340 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.002435 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.002872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.054651 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=16 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:51.090078 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4265728a-255e-4c39-8357-5e8df6993e48 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:51.091056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4265728a-255e-4c39-8357-5e8df6993e48 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:51.098125 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4265728a-255e-4c39-8357-5e8df6993e48 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.099147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4265728a-255e-4c39-8357-5e8df6993e48 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.100213 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4265728a-255e-4c39-8357-5e8df6993e48 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.100897 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4265728a-255e-4c39-8357-5e8df6993e48 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.174306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:51.187487 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:51.189225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:51.190839 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0a8b3a71-6471-43ca-a74d-171ba6ab8c75 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.203452 Aug 01 14:18:51.191774 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 561/1107] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:50 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:51.318688 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4265728a-255e-4c39-8357-5e8df6993e48 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:51.327896 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4265728a-255e-4c39-8357-5e8df6993e48 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.243964 Aug 01 14:18:51.342086 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 547/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:51 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:51.483617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-86e7bc2b-5068-4fde-be2b-c0c306ff11ce tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:51.484239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-86e7bc2b-5068-4fde-be2b-c0c306ff11ce tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:51.490640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-86e7bc2b-5068-4fde-be2b-c0c306ff11ce tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.491100 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-86e7bc2b-5068-4fde-be2b-c0c306ff11ce tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.492092 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-86e7bc2b-5068-4fde-be2b-c0c306ff11ce tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.492718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-86e7bc2b-5068-4fde-be2b-c0c306ff11ce tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.647835 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-86e7bc2b-5068-4fde-be2b-c0c306ff11ce tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:51.657709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-86e7bc2b-5068-4fde-be2b-c0c306ff11ce tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.177933 Aug 01 14:18:51.658602 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 562/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:51 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:51.732734 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-2de9f87b-038c-4a4d-b028-b83d1a0c097a req-0a00d838-3d7f-4a7f-a684-0c094e30b0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3639d3f-a4f5-49b1-bd17-26c44c0113ba", "name": "network-vif-plugged", "status": "completed", "tag": "ad876c77-136b-4537-bd94-96619059c312"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:51.742980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-85662f20-d157-4846-ae43-d3b6f77859ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:51.744175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-85662f20-d157-4846-ae43-d3b6f77859ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:51.747166 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-2de9f87b-038c-4a4d-b028-b83d1a0c097a req-0a00d838-3d7f-4a7f-a684-0c094e30b0f2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.747726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-2de9f87b-038c-4a4d-b028-b83d1a0c097a req-0a00d838-3d7f-4a7f-a684-0c094e30b0f2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.750577 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-85662f20-d157-4846-ae43-d3b6f77859ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.752210 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-85662f20-d157-4846-ae43-d3b6f77859ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.752210 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-85662f20-d157-4846-ae43-d3b6f77859ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:51.752454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-85662f20-d157-4846-ae43-d3b6f77859ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:51.762670 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-2de9f87b-038c-4a4d-b028-b83d1a0c097a req-0a00d838-3d7f-4a7f-a684-0c094e30b0f2 service nova] Creating event network-vif-plugged:ad876c77-136b-4537-bd94-96619059c312 for instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba on hv-cinder-84713 Aug 01 14:18:51.769213 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-2de9f87b-038c-4a4d-b028-b83d1a0c097a req-0a00d838-3d7f-4a7f-a684-0c094e30b0f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040146 Aug 01 14:18:51.770199 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 548/1110] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:51.910372 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-85662f20-d157-4846-ae43-d3b6f77859ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:51.919090 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-85662f20-d157-4846-ae43-d3b6f77859ed tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.179856 Aug 01 14:18:51.919677 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 563/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:51 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:52.219841 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:52.220939 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:52.232683 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.234295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:52.236418 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.237451 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:52.354119 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-cdd3ef80-f9d5-4f38-a804-851fe46efe0c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:52.355391 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-cdd3ef80-f9d5-4f38-a804-851fe46efe0c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:52.363010 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cdd3ef80-f9d5-4f38-a804-851fe46efe0c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.363522 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cdd3ef80-f9d5-4f38-a804-851fe46efe0c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:52.364313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cdd3ef80-f9d5-4f38-a804-851fe46efe0c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.364781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cdd3ef80-f9d5-4f38-a804-851fe46efe0c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:52.420203 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:52.434106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:52.438744 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:52.440394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be1bf89e-4678-420f-b07b-f5c816a0aac8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.225533 Aug 01 14:18:52.452846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 549/1112] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:52 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:52.513388 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-cdd3ef80-f9d5-4f38-a804-851fe46efe0c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:52.522944 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-cdd3ef80-f9d5-4f38-a804-851fe46efe0c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1362 microversion: 2.1 time: 0.173111 Aug 01 14:18:52.523556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 564/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:52 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:52.680539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ba7dccce-bb5c-47d6-be41-48bda3e414f0 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:52.680539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ba7dccce-bb5c-47d6-be41-48bda3e414f0 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:52.686756 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba7dccce-bb5c-47d6-be41-48bda3e414f0 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.687135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba7dccce-bb5c-47d6-be41-48bda3e414f0 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:52.687998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba7dccce-bb5c-47d6-be41-48bda3e414f0 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.688400 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba7dccce-bb5c-47d6-be41-48bda3e414f0 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:52.837521 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ba7dccce-bb5c-47d6-be41-48bda3e414f0 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:52.846949 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ba7dccce-bb5c-47d6-be41-48bda3e414f0 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.171937 Aug 01 14:18:52.847562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 550/1114] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:52 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:52.943394 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0f36211a-9cd9-4af2-9a97-10b52fdfce82 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:52.944460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0f36211a-9cd9-4af2-9a97-10b52fdfce82 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:52.952523 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0f36211a-9cd9-4af2-9a97-10b52fdfce82 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.953262 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0f36211a-9cd9-4af2-9a97-10b52fdfce82 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:52.954048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0f36211a-9cd9-4af2-9a97-10b52fdfce82 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:52.954485 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0f36211a-9cd9-4af2-9a97-10b52fdfce82 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.097084 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0f36211a-9cd9-4af2-9a97-10b52fdfce82 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:53.105846 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0f36211a-9cd9-4af2-9a97-10b52fdfce82 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.167298 Aug 01 14:18:53.106710 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 565/1115] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:52 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:53.468672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:53.469621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:53.475611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:53.480869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=8 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:53.483742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:53.484208 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.485444 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:53.486226 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.543697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2896118d-6e10-4d94-98a3-459dbe19ac36 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:53.544956 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2896118d-6e10-4d94-98a3-459dbe19ac36 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:53.557462 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2896118d-6e10-4d94-98a3-459dbe19ac36 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:53.558275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2896118d-6e10-4d94-98a3-459dbe19ac36 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.559812 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2896118d-6e10-4d94-98a3-459dbe19ac36 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:53.560935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2896118d-6e10-4d94-98a3-459dbe19ac36 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.791512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2896118d-6e10-4d94-98a3-459dbe19ac36 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:53.808568 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2896118d-6e10-4d94-98a3-459dbe19ac36 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1547 microversion: 2.1 time: 0.269073 Aug 01 14:18:53.829144 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 566/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:53 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1547 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:53.831762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b70cd3a7-ec23-4634-b581-dca5a4999d4e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:53.832239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b70cd3a7-ec23-4634-b581-dca5a4999d4e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:53.839665 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b70cd3a7-ec23-4634-b581-dca5a4999d4e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:53.840169 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b70cd3a7-ec23-4634-b581-dca5a4999d4e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.840986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b70cd3a7-ec23-4634-b581-dca5a4999d4e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:53.841426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b70cd3a7-ec23-4634-b581-dca5a4999d4e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.940243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:53.954533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:53.956515 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:53.957707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-75d5de53-b1dc-478f-844b-17d2fdeebb7d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.495935 Aug 01 14:18:53.958966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 551/1117] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:53 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:53.969117 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fa06572a-4093-4f1a-8ae8-fef0c7010e2a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:53.969887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fa06572a-4093-4f1a-8ae8-fef0c7010e2a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:53.984170 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa06572a-4093-4f1a-8ae8-fef0c7010e2a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:53.984686 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa06572a-4093-4f1a-8ae8-fef0c7010e2a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:53.985484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa06572a-4093-4f1a-8ae8-fef0c7010e2a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:53.985922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fa06572a-4093-4f1a-8ae8-fef0c7010e2a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:54.001082 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b70cd3a7-ec23-4634-b581-dca5a4999d4e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174920 Aug 01 14:18:54.001922 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 567/1118] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 14:18:53 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:54.126915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-edf524c7-21c6-4865-8e3b-95288f988b4a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:54.127686 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-edf524c7-21c6-4865-8e3b-95288f988b4a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:54.135371 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-edf524c7-21c6-4865-8e3b-95288f988b4a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:54.136520 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-edf524c7-21c6-4865-8e3b-95288f988b4a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:54.137423 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-edf524c7-21c6-4865-8e3b-95288f988b4a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:54.137986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-edf524c7-21c6-4865-8e3b-95288f988b4a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:54.310427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-edf524c7-21c6-4865-8e3b-95288f988b4a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:54.319781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-edf524c7-21c6-4865-8e3b-95288f988b4a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.197024 Aug 01 14:18:54.320533 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 568/1119] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:54 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:54.380880 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fa06572a-4093-4f1a-8ae8-fef0c7010e2a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:54.389164 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fa06572a-4093-4f1a-8ae8-fef0c7010e2a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.428934 Aug 01 14:18:54.403904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 552/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:53 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:54.987318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:54.989254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:54.994861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:54.995654 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:54.996753 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:54.997482 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.172367 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:55.184467 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:55.187281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:55.191881 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-39c993d7-19e7-44d7-9182-34fb4c2736a5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.207993 Aug 01 14:18:55.192891 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 569/1121] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:54 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:18:55.251596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-41ff7eda-6372-477a-962a-4c9c6beabc15 req-68b2ca0a-b1d9-4b10-8d7e-ebc87194b08f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48a8a080-a34d-4ba9-8131-f502e8a54ff4", "tag": "bf39acbe-27ee-4f84-a849-b6d623845fab"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:55.278132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-41ff7eda-6372-477a-962a-4c9c6beabc15 req-68b2ca0a-b1d9-4b10-8d7e-ebc87194b08f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.278839 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-41ff7eda-6372-477a-962a-4c9c6beabc15 req-68b2ca0a-b1d9-4b10-8d7e-ebc87194b08f service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.291376 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-41ff7eda-6372-477a-962a-4c9c6beabc15 req-68b2ca0a-b1d9-4b10-8d7e-ebc87194b08f service nova] Creating event network-changed:bf39acbe-27ee-4f84-a849-b6d623845fab for instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 on hv-cinder-84713 Aug 01 14:18:55.298309 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-41ff7eda-6372-477a-962a-4c9c6beabc15 req-68b2ca0a-b1d9-4b10-8d7e-ebc87194b08f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055398 Aug 01 14:18:55.299527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 553/1122] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:55.342317 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-22461410-8b44-4095-8769-dfd9d520eea0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:55.344032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-22461410-8b44-4095-8769-dfd9d520eea0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:55.356306 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22461410-8b44-4095-8769-dfd9d520eea0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.357093 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22461410-8b44-4095-8769-dfd9d520eea0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.359517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22461410-8b44-4095-8769-dfd9d520eea0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.360750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-22461410-8b44-4095-8769-dfd9d520eea0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.412353 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-16e01c4c-2ca9-4984-92b1-e62a2cbd44eb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:55.413475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-16e01c4c-2ca9-4984-92b1-e62a2cbd44eb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:55.427303 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16e01c4c-2ca9-4984-92b1-e62a2cbd44eb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.429005 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16e01c4c-2ca9-4984-92b1-e62a2cbd44eb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.431724 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16e01c4c-2ca9-4984-92b1-e62a2cbd44eb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.432348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-16e01c4c-2ca9-4984-92b1-e62a2cbd44eb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.638003 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-22461410-8b44-4095-8769-dfd9d520eea0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:55.650788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-22461410-8b44-4095-8769-dfd9d520eea0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1367 microversion: 2.1 time: 0.312042 Aug 01 14:18:55.652518 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 570/1123] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:55 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1367 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:55.685779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-16e01c4c-2ca9-4984-92b1-e62a2cbd44eb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:55.694828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-16e01c4c-2ca9-4984-92b1-e62a2cbd44eb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1509 microversion: 2.1 time: 0.287413 Aug 01 14:18:55.705018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 554/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:55 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1509 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:55.717583 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-24553c13-986d-443c-a412-6a20601ab822 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:55.718267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-24553c13-986d-443c-a412-6a20601ab822 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:55.724843 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-24553c13-986d-443c-a412-6a20601ab822 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.725431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-24553c13-986d-443c-a412-6a20601ab822 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.726183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-24553c13-986d-443c-a412-6a20601ab822 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.730117 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-24553c13-986d-443c-a412-6a20601ab822 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.766897 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-24553c13-986d-443c-a412-6a20601ab822 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117857) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:18:55.886399 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-24553c13-986d-443c-a412-6a20601ab822 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "POST /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7/action" status: 202 len: 0 microversion: 2.1 time: 0.173373 Aug 01 14:18:55.889083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 571/1125] 10.222.0.48 () {60 vars in 1278 bytes} [Mon Aug 1 14:18:55 2022] POST /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:18:55.897092 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-228189b6-6b80-422d-a355-57fb36ac145c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:55.898031 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-228189b6-6b80-422d-a355-57fb36ac145c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:55.906256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-228189b6-6b80-422d-a355-57fb36ac145c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.909051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-228189b6-6b80-422d-a355-57fb36ac145c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:55.909925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-228189b6-6b80-422d-a355-57fb36ac145c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:55.910519 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-228189b6-6b80-422d-a355-57fb36ac145c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:56.205163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-228189b6-6b80-422d-a355-57fb36ac145c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:56.216764 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-228189b6-6b80-422d-a355-57fb36ac145c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1517 microversion: 2.1 time: 0.323259 Aug 01 14:18:56.217867 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 555/1126] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:55 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1517 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:18:56.233974 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:56.234733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:56.251159 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:56.254836 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:56.255754 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:56.256208 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:56.260760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:56.566937 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:56.575838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:56.578531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:56.579763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-0e84a491-e87d-4763-a936-bdf84d3c77a4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.349963 Aug 01 14:18:56.580325 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 572/1127] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:56 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:56.676399 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d5d59b5d-fa2f-46de-a11f-8215e37ce57a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:56.677124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d5d59b5d-fa2f-46de-a11f-8215e37ce57a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:56.696017 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5d59b5d-fa2f-46de-a11f-8215e37ce57a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:56.696538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5d59b5d-fa2f-46de-a11f-8215e37ce57a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:56.700157 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5d59b5d-fa2f-46de-a11f-8215e37ce57a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:56.700668 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5d59b5d-fa2f-46de-a11f-8215e37ce57a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:56.914436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d5d59b5d-fa2f-46de-a11f-8215e37ce57a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:56.932435 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d5d59b5d-fa2f-46de-a11f-8215e37ce57a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1557 microversion: 2.1 time: 0.257608 Aug 01 14:18:56.933362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 556/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:56 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1557 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:56.964294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-592a084f-faa0-4f87-9792-62f55632b4b6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:56.964877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-592a084f-faa0-4f87-9792-62f55632b4b6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:56.983538 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-592a084f-faa0-4f87-9792-62f55632b4b6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:56.984595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-592a084f-faa0-4f87-9792-62f55632b4b6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:56.986727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-592a084f-faa0-4f87-9792-62f55632b4b6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:56.987378 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-592a084f-faa0-4f87-9792-62f55632b4b6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:57.108735 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-592a084f-faa0-4f87-9792-62f55632b4b6 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151759 Aug 01 14:18:57.109439 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 573/1129] 10.222.0.48 () {58 vars in 1275 bytes} [Mon Aug 1 14:18:56 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:18:57.239871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-53fc474c-07a7-4a0f-a7c9-621327b1e151 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:57.240883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-53fc474c-07a7-4a0f-a7c9-621327b1e151 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:57.250632 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-53fc474c-07a7-4a0f-a7c9-621327b1e151 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:57.253568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-53fc474c-07a7-4a0f-a7c9-621327b1e151 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:57.255050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-53fc474c-07a7-4a0f-a7c9-621327b1e151 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:57.255607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-53fc474c-07a7-4a0f-a7c9-621327b1e151 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:57.306979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:57.471616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-53fc474c-07a7-4a0f-a7c9-621327b1e151 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:57.481933 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-53fc474c-07a7-4a0f-a7c9-621327b1e151 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1519 microversion: 2.1 time: 0.246111 Aug 01 14:18:57.497852 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 557/1130] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:57 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1519 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:57.546053 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-d159c513-e182-4ab8-83e6-a7bab6942a27 req-51ef9d1d-ecab-4b6a-bfa6-4fa28a4735ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be944f58-3d1b-43af-bd53-5d0f0c17f6a7", "name": "network-vif-unplugged", "status": "completed", "tag": "6557d142-b394-4c3c-b200-64bd14908f59"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:57.559752 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d159c513-e182-4ab8-83e6-a7bab6942a27 req-51ef9d1d-ecab-4b6a-bfa6-4fa28a4735ed service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:57.560572 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-d159c513-e182-4ab8-83e6-a7bab6942a27 req-51ef9d1d-ecab-4b6a-bfa6-4fa28a4735ed service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:57.578611 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.compute.server_external_events [req-d159c513-e182-4ab8-83e6-a7bab6942a27 req-51ef9d1d-ecab-4b6a-bfa6-4fa28a4735ed service nova] Unable to find a host for instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7. Dropping event network-vif-unplugged {{(pid=117857) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 14:18:57.579810 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-d159c513-e182-4ab8-83e6-a7bab6942a27 req-51ef9d1d-ecab-4b6a-bfa6-4fa28a4735ed service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037630 Aug 01 14:18:57.580613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 574/1131] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 14:18:57.605929 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:57.606903 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:57.613636 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:57.618852 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:57.620044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:57.620562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:57.817350 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:57.835029 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:57.837374 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:57.838737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d20f5af5-d10c-42e8-bc5f-0313f2bc0a65 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.237515 Aug 01 14:18:57.839910 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 558/1132] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:57 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:58.505374 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d84aef1d-5c8d-4426-b785-e78982a4372b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:58.506629 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d84aef1d-5c8d-4426-b785-e78982a4372b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:58.513776 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d84aef1d-5c8d-4426-b785-e78982a4372b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:58.516813 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d84aef1d-5c8d-4426-b785-e78982a4372b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:58.518433 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d84aef1d-5c8d-4426-b785-e78982a4372b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:58.519375 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d84aef1d-5c8d-4426-b785-e78982a4372b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:58.668658 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-5026e3b6-2f14-4806-a3a0-8310792512bc req-3b778477-9df3-4e1b-85bd-2318fdbc40b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3639d3f-a4f5-49b1-bd17-26c44c0113ba", "tag": "ad876c77-136b-4537-bd94-96619059c312"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:18:58.681825 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5026e3b6-2f14-4806-a3a0-8310792512bc req-3b778477-9df3-4e1b-85bd-2318fdbc40b3 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:58.682497 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-5026e3b6-2f14-4806-a3a0-8310792512bc req-3b778477-9df3-4e1b-85bd-2318fdbc40b3 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:58.700798 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-5026e3b6-2f14-4806-a3a0-8310792512bc req-3b778477-9df3-4e1b-85bd-2318fdbc40b3 service nova] Creating event network-changed:ad876c77-136b-4537-bd94-96619059c312 for instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba on hv-cinder-84713 Aug 01 14:18:58.706024 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-5026e3b6-2f14-4806-a3a0-8310792512bc req-3b778477-9df3-4e1b-85bd-2318fdbc40b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042819 Aug 01 14:18:58.711674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 559/1133] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:18:58.862062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:58.866187 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:58.872997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:58.873704 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:58.874815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:58.875644 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:58.939204 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d84aef1d-5c8d-4426-b785-e78982a4372b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:58.951056 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d84aef1d-5c8d-4426-b785-e78982a4372b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.449336 Aug 01 14:18:58.951644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 575/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:58 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:18:59.153216 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:59.162732 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:59.168425 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:18:59.171101 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0c3f0ba5-c3b3-4880-a3db-7eb080d4fa35 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.313303 Aug 01 14:18:59.173901 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 560/1135] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:18:58 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:18:59.980369 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8026806f-9586-417e-a463-0cfd89dd8c56 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:18:59.981390 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8026806f-9586-417e-a463-0cfd89dd8c56 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:18:59.989928 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8026806f-9586-417e-a463-0cfd89dd8c56 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:59.990697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8026806f-9586-417e-a463-0cfd89dd8c56 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:18:59.991563 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8026806f-9586-417e-a463-0cfd89dd8c56 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:18:59.991945 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8026806f-9586-417e-a463-0cfd89dd8c56 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:00.194484 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:00.195294 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:00.203542 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:00.204051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:00.205036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:00.205528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:00.262898 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8026806f-9586-417e-a463-0cfd89dd8c56 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:00.275806 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8026806f-9586-417e-a463-0cfd89dd8c56 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.302985 Aug 01 14:19:00.277850 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 576/1136] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:18:59 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:00.393490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:00.402559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:00.404332 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:00.405700 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-61c153e0-b1c1-46cf-9c7a-6e0e900e0bbc tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.215827 Aug 01 14:19:00.420814 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 561/1137] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:00 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:01.299585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7d5e261c-5ae4-4f83-bee0-9bad2e6051ba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:01.300198 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7d5e261c-5ae4-4f83-bee0-9bad2e6051ba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:01.306781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7d5e261c-5ae4-4f83-bee0-9bad2e6051ba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:01.307229 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7d5e261c-5ae4-4f83-bee0-9bad2e6051ba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:01.307987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7d5e261c-5ae4-4f83-bee0-9bad2e6051ba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:01.308426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7d5e261c-5ae4-4f83-bee0-9bad2e6051ba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:01.429701 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:01.430964 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:01.437690 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:01.438145 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:01.438932 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:01.439365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:01.444619 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-7d5e261c-5ae4-4f83-bee0-9bad2e6051ba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:01.452646 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7d5e261c-5ae4-4f83-bee0-9bad2e6051ba tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.156828 Aug 01 14:19:01.453153 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 577/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:01 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:01.566769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:01.575335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:01.576884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:01.578048 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6299c3ea-3739-489b-8729-12fc8cfa0f58 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1739 microversion: 2.20 time: 0.152339 Aug 01 14:19:01.578650 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 562/1139] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:01 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:02.474608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-25d38c56-45ea-4f19-a65a-7c373f2fd38d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:02.475228 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-25d38c56-45ea-4f19-a65a-7c373f2fd38d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:02.482661 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25d38c56-45ea-4f19-a65a-7c373f2fd38d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:02.483117 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25d38c56-45ea-4f19-a65a-7c373f2fd38d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:02.483925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25d38c56-45ea-4f19-a65a-7c373f2fd38d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:02.484369 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-25d38c56-45ea-4f19-a65a-7c373f2fd38d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:02.601665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:02.603098 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:02.609802 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:02.610375 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:02.611391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:02.611715 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:02.615449 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-25d38c56-45ea-4f19-a65a-7c373f2fd38d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:02.622990 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-25d38c56-45ea-4f19-a65a-7c373f2fd38d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.152313 Aug 01 14:19:02.623565 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 578/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:02 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:02.743993 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:02.751836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:02.753377 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:02.754527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-75fce9dc-0b46-4aea-857a-093038e56929 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1721 microversion: 2.20 time: 0.156834 Aug 01 14:19:02.755097 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 563/1141] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:02 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:03.644298 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-08239b98-32f7-43c8-9b5d-14df814923a4 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:03.644947 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-08239b98-32f7-43c8-9b5d-14df814923a4 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:03.652201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-08239b98-32f7-43c8-9b5d-14df814923a4 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:03.652693 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-08239b98-32f7-43c8-9b5d-14df814923a4 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:03.653557 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-08239b98-32f7-43c8-9b5d-14df814923a4 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:03.654049 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-08239b98-32f7-43c8-9b5d-14df814923a4 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:03.778101 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:03.778721 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:03.782509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-08239b98-32f7-43c8-9b5d-14df814923a4 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:03.785230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:03.785863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:03.786801 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:03.787245 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:03.790503 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-08239b98-32f7-43c8-9b5d-14df814923a4 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.150046 Aug 01 14:19:03.791081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 579/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:03 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:03.916687 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:03.924702 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:03.926211 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:03.927365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e4310d9a-ab22-4f8c-8e6d-9088a25ce5b5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1721 microversion: 2.20 time: 0.153667 Aug 01 14:19:03.928122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 564/1143] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:03 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:04.812777 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-38966b0b-ff9b-4aba-a08e-64b250e58b5f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:04.813396 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-38966b0b-ff9b-4aba-a08e-64b250e58b5f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:04.821585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38966b0b-ff9b-4aba-a08e-64b250e58b5f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:04.822035 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38966b0b-ff9b-4aba-a08e-64b250e58b5f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:04.822812 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38966b0b-ff9b-4aba-a08e-64b250e58b5f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:04.823254 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-38966b0b-ff9b-4aba-a08e-64b250e58b5f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:04.951092 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:04.951698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:04.958193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:04.958485 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-38966b0b-ff9b-4aba-a08e-64b250e58b5f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:04.958645 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:04.959618 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:04.960060 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:04.966474 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-38966b0b-ff9b-4aba-a08e-64b250e58b5f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.158551 Aug 01 14:19:04.967044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 580/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:04 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:05.092286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:05.100927 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:05.103183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:05.104345 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d512557a-98fc-4e30-8fdc-b1794381c19f tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1724 microversion: 2.20 time: 0.157269 Aug 01 14:19:05.104949 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 565/1145] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:04 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:05.126841 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6498c4d3-405a-45a3-bcb3-1f587c1f70e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b42de704-30ad-4cd4-b46d-54a99aa96619"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:05.129252 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6498c4d3-405a-45a3-bcb3-1f587c1f70e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:05.135244 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6498c4d3-405a-45a3-bcb3-1f587c1f70e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.135696 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6498c4d3-405a-45a3-bcb3-1f587c1f70e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.136459 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6498c4d3-405a-45a3-bcb3-1f587c1f70e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.136925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6498c4d3-405a-45a3-bcb3-1f587c1f70e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.401505 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6498c4d3-405a-45a3-bcb3-1f587c1f70e8 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.278710 Aug 01 14:19:05.402215 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 581/1146] 10.222.0.48 () {62 vars in 1364 bytes} [Mon Aug 1 14:19:05 2022] POST /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/os-volume_attachments => generated 188 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 01 14:19:05.485737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-fa3e788b-99d4-4fef-8e92-f09f31f8168d req-112ac4ed-7c45-4a4b-a303-19af8db27d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900b90f4-dd21-4df9-a880-5760f2c62ae5", "name": "network-vif-unplugged", "status": "completed", "tag": "27822eab-07c3-4ba4-b4e4-e82eaa97336f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:05.496138 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fa3e788b-99d4-4fef-8e92-f09f31f8168d req-112ac4ed-7c45-4a4b-a303-19af8db27d23 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.496687 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fa3e788b-99d4-4fef-8e92-f09f31f8168d req-112ac4ed-7c45-4a4b-a303-19af8db27d23 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.509173 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.compute.server_external_events [req-fa3e788b-99d4-4fef-8e92-f09f31f8168d req-112ac4ed-7c45-4a4b-a303-19af8db27d23 service nova] Unable to find a host for instance 900b90f4-dd21-4df9-a880-5760f2c62ae5. Dropping event network-vif-unplugged {{(pid=117859) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 01 14:19:05.510124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-fa3e788b-99d4-4fef-8e92-f09f31f8168d req-112ac4ed-7c45-4a4b-a303-19af8db27d23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028459 Aug 01 14:19:05.510882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 566/1147] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 01 14:19:05.527103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-91199259-c1d2-4d2e-b1b9-0a92b26348df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:05.527696 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-91199259-c1d2-4d2e-b1b9-0a92b26348df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:05.533796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91199259-c1d2-4d2e-b1b9-0a92b26348df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.534323 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91199259-c1d2-4d2e-b1b9-0a92b26348df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.535156 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91199259-c1d2-4d2e-b1b9-0a92b26348df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.535659 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91199259-c1d2-4d2e-b1b9-0a92b26348df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.773358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-91199259-c1d2-4d2e-b1b9-0a92b26348df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "DELETE /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/os-volume_attachments/b42de704-30ad-4cd4-b46d-54a99aa96619" status: 202 len: 0 microversion: 2.20 time: 0.250880 Aug 01 14:19:05.774446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 582/1148] 10.222.0.48 () {60 vars in 1457 bytes} [Mon Aug 1 14:19:05 2022] DELETE /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/os-volume_attachments/b42de704-30ad-4cd4-b46d-54a99aa96619 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:19:05.833774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5c721511-010f-4d00-976f-af975e12e1e6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:05.834406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5c721511-010f-4d00-976f-af975e12e1e6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:05.840942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c721511-010f-4d00-976f-af975e12e1e6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.841394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c721511-010f-4d00-976f-af975e12e1e6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.842160 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c721511-010f-4d00-976f-af975e12e1e6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.842595 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c721511-010f-4d00-976f-af975e12e1e6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.887381 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5c721511-010f-4d00-976f-af975e12e1e6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=117859) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 01 14:19:05.953036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5c721511-010f-4d00-976f-af975e12e1e6 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "POST /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/action" status: 202 len: 0 microversion: 2.20 time: 0.123181 Aug 01 14:19:05.953704 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 567/1149] 10.222.0.48 () {62 vars in 1319 bytes} [Mon Aug 1 14:19:05 2022] POST /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:19:05.962753 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:05.963520 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:05.970644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.971094 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.972063 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.972637 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.988383 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a3a6f4b-12b3-4662-b047-3b9e9554ae19 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:05.989057 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a3a6f4b-12b3-4662-b047-3b9e9554ae19 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:05.995855 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a3a6f4b-12b3-4662-b047-3b9e9554ae19 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.996351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a3a6f4b-12b3-4662-b047-3b9e9554ae19 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:05.997189 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a3a6f4b-12b3-4662-b047-3b9e9554ae19 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:05.997685 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a3a6f4b-12b3-4662-b047-3b9e9554ae19 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:06.118420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:06.127143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:06.128904 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:06.130008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-29b7115c-7a91-4a75-9e8a-afcb792a1c44 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1672 microversion: 2.20 time: 0.172115 Aug 01 14:19:06.130629 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 583/1150] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:05 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1672 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:06.149433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a3a6f4b-12b3-4662-b047-3b9e9554ae19 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:06.157538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a3a6f4b-12b3-4662-b047-3b9e9554ae19 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.173721 Aug 01 14:19:06.158514 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 568/1151] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:05 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:07.154162 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:07.154815 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:07.161346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:07.161794 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:07.162583 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:07.163009 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:07.179040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-64412923-f8f5-43ec-81d8-e08ee7c50671 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:07.179655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-64412923-f8f5-43ec-81d8-e08ee7c50671 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:07.186315 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64412923-f8f5-43ec-81d8-e08ee7c50671 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:07.186764 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64412923-f8f5-43ec-81d8-e08ee7c50671 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:07.187528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64412923-f8f5-43ec-81d8-e08ee7c50671 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:07.187963 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64412923-f8f5-43ec-81d8-e08ee7c50671 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:07.303435 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:07.305809 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:07.317191 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:07.319412 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:07.320677 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ba0672b8-2604-4925-9e94-a70d8027ff71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1672 microversion: 2.20 time: 0.170665 Aug 01 14:19:07.321230 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 584/1152] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:07 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1672 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:07.338367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-64412923-f8f5-43ec-81d8-e08ee7c50671 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:07.346154 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-64412923-f8f5-43ec-81d8-e08ee7c50671 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.170716 Aug 01 14:19:07.346640 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 569/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:07 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:08.344987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:08.345610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:08.353145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:08.353599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:08.354366 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:08.354806 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:08.368195 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5ae8ae63-b847-49eb-aa27-a2622b1cfaec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:08.368856 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5ae8ae63-b847-49eb-aa27-a2622b1cfaec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:08.375273 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ae8ae63-b847-49eb-aa27-a2622b1cfaec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:08.375731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ae8ae63-b847-49eb-aa27-a2622b1cfaec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:08.376599 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ae8ae63-b847-49eb-aa27-a2622b1cfaec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:08.376966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ae8ae63-b847-49eb-aa27-a2622b1cfaec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:08.484866 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:08.493656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:08.495262 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:08.496528 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e1a6d2d2-903c-4378-b067-d6751819b9c4 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.156943 Aug 01 14:19:08.497182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 585/1154] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:08 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:08.514102 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5ae8ae63-b847-49eb-aa27-a2622b1cfaec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:08.521693 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5ae8ae63-b847-49eb-aa27-a2622b1cfaec tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.157881 Aug 01 14:19:08.522265 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 570/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:08 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:09.519862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:09.520405 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:09.527448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:09.527902 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:09.528709 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:09.529152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:09.543732 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d2f97004-d6ce-41ad-86bb-3f249930f124 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:09.544443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d2f97004-d6ce-41ad-86bb-3f249930f124 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:09.550818 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2f97004-d6ce-41ad-86bb-3f249930f124 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:09.551359 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2f97004-d6ce-41ad-86bb-3f249930f124 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:09.552253 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2f97004-d6ce-41ad-86bb-3f249930f124 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:09.552777 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2f97004-d6ce-41ad-86bb-3f249930f124 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:09.660838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:09.669313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:09.670805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:09.671960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-78336099-e1bb-4aa1-852e-b9608921fca5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.156136 Aug 01 14:19:09.672532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 586/1156] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:09 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:09.685182 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d2f97004-d6ce-41ad-86bb-3f249930f124 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:09.693034 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d2f97004-d6ce-41ad-86bb-3f249930f124 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.153860 Aug 01 14:19:09.693606 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 571/1157] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:09 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:10.694923 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:10.696026 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:10.702432 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:10.702877 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:10.703624 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:10.704062 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:10.715553 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f793e7bc-ebac-413e-bf52-ae7d8f72ee90 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:10.716167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f793e7bc-ebac-413e-bf52-ae7d8f72ee90 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:10.722525 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f793e7bc-ebac-413e-bf52-ae7d8f72ee90 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:10.722972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f793e7bc-ebac-413e-bf52-ae7d8f72ee90 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:10.723754 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f793e7bc-ebac-413e-bf52-ae7d8f72ee90 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:10.724243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f793e7bc-ebac-413e-bf52-ae7d8f72ee90 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:10.841587 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:10.853762 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:10.855283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:10.856443 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-744dd3a5-3114-4966-b747-d624db4537ad tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.165778 Aug 01 14:19:10.857027 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 587/1158] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:10 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:10.864373 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f793e7bc-ebac-413e-bf52-ae7d8f72ee90 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:10.875775 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f793e7bc-ebac-413e-bf52-ae7d8f72ee90 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.164737 Aug 01 14:19:10.876810 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 572/1159] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:10 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:11.880555 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:11.881176 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:11.883563 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:11.889171 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:11.889635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:11.890398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:11.890835 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:11.898087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b1b228e8-2170-4d5d-bb12-4915d1caed1a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:11.899407 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b1b228e8-2170-4d5d-bb12-4915d1caed1a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:11.906972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1b228e8-2170-4d5d-bb12-4915d1caed1a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:11.907682 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1b228e8-2170-4d5d-bb12-4915d1caed1a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:11.908693 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1b228e8-2170-4d5d-bb12-4915d1caed1a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:11.909568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1b228e8-2170-4d5d-bb12-4915d1caed1a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:12.030125 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:12.040338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:12.042034 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:12.043328 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-74578a19-fc7f-4465-85e7-bfa2528a28da tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.166675 Aug 01 14:19:12.043975 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 588/1160] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:11 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:12.075302 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b1b228e8-2170-4d5d-bb12-4915d1caed1a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:12.085475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b1b228e8-2170-4d5d-bb12-4915d1caed1a tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.190998 Aug 01 14:19:12.086828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 573/1161] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:11 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:13.067187 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:13.067789 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:13.074556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:13.075008 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:13.075984 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:13.076418 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:13.108115 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f84c6dec-f1c3-4ccd-927a-84610fe73436 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:13.109337 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f84c6dec-f1c3-4ccd-927a-84610fe73436 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:13.116122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f84c6dec-f1c3-4ccd-927a-84610fe73436 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:13.116610 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f84c6dec-f1c3-4ccd-927a-84610fe73436 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:13.119476 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f84c6dec-f1c3-4ccd-927a-84610fe73436 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:13.120125 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f84c6dec-f1c3-4ccd-927a-84610fe73436 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:13.129055 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:13.218248 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:13.233404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:13.235341 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:13.236531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-64f1cd03-d719-496f-a1a3-b8fa09991197 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.173573 Aug 01 14:19:13.244428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 589/1162] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:13 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:13.279607 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f84c6dec-f1c3-4ccd-927a-84610fe73436 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:13.287472 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f84c6dec-f1c3-4ccd-927a-84610fe73436 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.183166 Aug 01 14:19:13.288243 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 574/1163] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:13 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:14.148800 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-f7ff54f2-4f85-4fe2-bf5d-198f15369520 req-e3d7a004-d92a-4f79-ab8d-d712590d3364 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be944f58-3d1b-43af-bd53-5d0f0c17f6a7", "name": "network-vif-plugged", "status": "completed", "tag": "6557d142-b394-4c3c-b200-64bd14908f59"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:14.160700 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-f7ff54f2-4f85-4fe2-bf5d-198f15369520 req-e3d7a004-d92a-4f79-ab8d-d712590d3364 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:14.161161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-f7ff54f2-4f85-4fe2-bf5d-198f15369520 req-e3d7a004-d92a-4f79-ab8d-d712590d3364 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:14.174581 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-f7ff54f2-4f85-4fe2-bf5d-198f15369520 req-e3d7a004-d92a-4f79-ab8d-d712590d3364 service nova] Creating event network-vif-plugged:6557d142-b394-4c3c-b200-64bd14908f59 for instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 on hv-cinder-84713 Aug 01 14:19:14.181159 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-f7ff54f2-4f85-4fe2-bf5d-198f15369520 req-e3d7a004-d92a-4f79-ab8d-d712590d3364 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035988 Aug 01 14:19:14.181887 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 590/1164] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:19:14.259364 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:14.260726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:14.270598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:14.271056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:14.271841 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:14.272279 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:14.312281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1aee3fe2-cb57-498f-bef2-13d578328dd5 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:14.313608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1aee3fe2-cb57-498f-bef2-13d578328dd5 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:14.321716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1aee3fe2-cb57-498f-bef2-13d578328dd5 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:14.322830 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1aee3fe2-cb57-498f-bef2-13d578328dd5 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:14.324276 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1aee3fe2-cb57-498f-bef2-13d578328dd5 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:14.324752 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1aee3fe2-cb57-498f-bef2-13d578328dd5 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:14.419977 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:14.433075 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:14.434746 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:14.436006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-35de98bb-2e4a-41d7-b295-84f9eb18c046 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.180834 Aug 01 14:19:14.437215 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 575/1165] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:14 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:14.480518 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1aee3fe2-cb57-498f-bef2-13d578328dd5 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:14.488418 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1aee3fe2-cb57-498f-bef2-13d578328dd5 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.181746 Aug 01 14:19:14.489065 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 591/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:14 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:15.459877 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:15.461029 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:15.467196 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:15.467639 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:15.468506 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:15.468942 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:15.511413 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3639135a-7a4f-45f2-9be3-7d2bf4a34991 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:15.512126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3639135a-7a4f-45f2-9be3-7d2bf4a34991 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:15.518520 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3639135a-7a4f-45f2-9be3-7d2bf4a34991 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:15.518960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3639135a-7a4f-45f2-9be3-7d2bf4a34991 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:15.519728 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3639135a-7a4f-45f2-9be3-7d2bf4a34991 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:15.520160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3639135a-7a4f-45f2-9be3-7d2bf4a34991 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:15.612475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:15.622604 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:15.624103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:15.625399 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2e1eee5d-2f33-46a2-bb89-c37743b5a75d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.169980 Aug 01 14:19:15.632779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 576/1167] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:15 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:15.679240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3639135a-7a4f-45f2-9be3-7d2bf4a34991 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:15.687240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3639135a-7a4f-45f2-9be3-7d2bf4a34991 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.179825 Aug 01 14:19:15.688006 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 592/1168] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:15 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:16.650885 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:16.651697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:16.658678 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:16.659351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:16.660331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:16.660804 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:16.711344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9a258c07-d316-4384-bd53-572b6e60565f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:16.712157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9a258c07-d316-4384-bd53-572b6e60565f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:16.719073 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9a258c07-d316-4384-bd53-572b6e60565f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:16.721112 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9a258c07-d316-4384-bd53-572b6e60565f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:16.722030 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9a258c07-d316-4384-bd53-572b6e60565f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:16.722596 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9a258c07-d316-4384-bd53-572b6e60565f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:16.816806 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:16.826040 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:16.829155 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:16.830381 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c5a5a542-eb1f-43ff-8be0-d41fb38312b7 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.184988 Aug 01 14:19:16.830951 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 577/1169] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:16 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:16.900165 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9a258c07-d316-4384-bd53-572b6e60565f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:16.908427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9a258c07-d316-4384-bd53-572b6e60565f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.202420 Aug 01 14:19:16.909048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 593/1170] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:16 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:17.107677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1247524408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-162466780", "security_groups": [{"name": "tempest-secgroup-smoke-1640434700"}], "block_device_mapping_v2": [{"uuid": "c86a0faf-adbe-40be-9c2f-1a244be0a435", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "867b8e09-a18b-436d-b07f-57394adda503"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:17.229823 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] validate_networks() for [('867b8e09-a18b-436d-b07f-57394adda503', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:19:17.628233 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:19:17.628756 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:19:17.629251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:19:17.629658 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:19:17.630066 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:19:17.640966 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.641413 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.642209 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.642643 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.660235 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Getting quotas for project 7bb93e302f1441fca85409de83230d6a. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:19:17.665139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Getting quotas for user 2eb09df64dd74ddeb9fbbf44ae0a3592 and project 7bb93e302f1441fca85409de83230d6a. Resources: {'cores', 'instances', 'ram'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:19:17.722925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:19:17.725068 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c86a0faf-adbe-40be-9c2f-1a244be0a435',volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:19:17.856764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:17.857396 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:17.870479 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.871689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.872885 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:17.873806 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:17.902787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-26961545-3d36-4f99-a56f-7dfb873092c7 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.799148 Aug 01 14:19:17.908545 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 578/1171] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:19:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:19:17.918564 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9adaa822-872f-4a9e-ae75-c6d524110d12 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:17.919212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9adaa822-872f-4a9e-ae75-c6d524110d12 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:18.047957 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9adaa822-872f-4a9e-ae75-c6d524110d12 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:18.055768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9adaa822-872f-4a9e-ae75-c6d524110d12 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1094 microversion: 2.1 time: 0.144022 Aug 01 14:19:18.059062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 579/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:17 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1094 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:18.076057 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0a8d3511-0782-4c5c-b96e-616871048a8f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:18.079902 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0a8d3511-0782-4c5c-b96e-616871048a8f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:18.089923 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a8d3511-0782-4c5c-b96e-616871048a8f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:18.090391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a8d3511-0782-4c5c-b96e-616871048a8f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:18.091268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a8d3511-0782-4c5c-b96e-616871048a8f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:18.091765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a8d3511-0782-4c5c-b96e-616871048a8f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:18.095927 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:18.108731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:18.116146 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:18.118273 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-864e6feb-90a7-48be-b564-f5028c7c8436 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.267314 Aug 01 14:19:18.125862 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 594/1173] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:17 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:18.273653 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0a8d3511-0782-4c5c-b96e-616871048a8f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:18.284372 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0a8d3511-0782-4c5c-b96e-616871048a8f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.223848 Aug 01 14:19:18.285095 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 580/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:18 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:19.080982 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5927b3b4-a774-4dae-93d5-812be8766cbb tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:19.081848 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5927b3b4-a774-4dae-93d5-812be8766cbb tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:19.088968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5927b3b4-a774-4dae-93d5-812be8766cbb tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.089452 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5927b3b4-a774-4dae-93d5-812be8766cbb tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.090238 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5927b3b4-a774-4dae-93d5-812be8766cbb tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.090711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5927b3b4-a774-4dae-93d5-812be8766cbb tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.141461 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:19.142321 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:19.149847 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.150301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.151078 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.151521 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.161960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5927b3b4-a774-4dae-93d5-812be8766cbb tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:19.170806 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5927b3b4-a774-4dae-93d5-812be8766cbb tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1144 microversion: 2.1 time: 0.093937 Aug 01 14:19:19.171701 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 595/1175] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:19 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:19.299352 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:19.305755 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-282a3542-c673-4236-94e5-19072ac7641c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:19.306376 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-282a3542-c673-4236-94e5-19072ac7641c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:19.307454 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:19.308987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:19.310142 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2931243c-64ce-46b3-95cd-8b799d022da0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.172756 Aug 01 14:19:19.310702 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 581/1176] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:19 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:19.312723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-282a3542-c673-4236-94e5-19072ac7641c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.313180 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-282a3542-c673-4236-94e5-19072ac7641c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.313970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-282a3542-c673-4236-94e5-19072ac7641c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:19.314416 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-282a3542-c673-4236-94e5-19072ac7641c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:19.448031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-282a3542-c673-4236-94e5-19072ac7641c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:19.455529 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-282a3542-c673-4236-94e5-19072ac7641c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.153626 Aug 01 14:19:19.456148 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 596/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:19 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:20.192538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ea3bee8-3438-44ce-b933-35383d69ad1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:20.193208 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6ea3bee8-3438-44ce-b933-35383d69ad1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:20.195703 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:20.203169 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ea3bee8-3438-44ce-b933-35383d69ad1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:20.203616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ea3bee8-3438-44ce-b933-35383d69ad1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:20.204424 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ea3bee8-3438-44ce-b933-35383d69ad1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:20.204890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ea3bee8-3438-44ce-b933-35383d69ad1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:20.281452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6ea3bee8-3438-44ce-b933-35383d69ad1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:20.289392 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6ea3bee8-3438-44ce-b933-35383d69ad1c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1144 microversion: 2.1 time: 0.100964 Aug 01 14:19:20.290046 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 582/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:20 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1144 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:20.335283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:20.336004 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:20.352703 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:20.353155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:20.353942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:20.354379 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:20.478952 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e238ab1f-f122-4e36-bc0f-7aa1bff0be62 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:20.479482 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e238ab1f-f122-4e36-bc0f-7aa1bff0be62 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:20.485675 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e238ab1f-f122-4e36-bc0f-7aa1bff0be62 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:20.486124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e238ab1f-f122-4e36-bc0f-7aa1bff0be62 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:20.486905 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e238ab1f-f122-4e36-bc0f-7aa1bff0be62 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:20.487345 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e238ab1f-f122-4e36-bc0f-7aa1bff0be62 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:20.504634 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:20.513610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:20.515689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:20.517106 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a441e13e-a3a4-45db-8443-d8c0ad7cbb1b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.185793 Aug 01 14:19:20.518259 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 597/1179] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:20 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:20.627282 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e238ab1f-f122-4e36-bc0f-7aa1bff0be62 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:20.635020 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e238ab1f-f122-4e36-bc0f-7aa1bff0be62 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.160552 Aug 01 14:19:20.635594 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 583/1180] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:20 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:21.311768 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-cd1394f4-e8a3-4ea0-a6f5-6a1f146ce6f8 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:21.312387 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-cd1394f4-e8a3-4ea0-a6f5-6a1f146ce6f8 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:21.318861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd1394f4-e8a3-4ea0-a6f5-6a1f146ce6f8 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:21.319969 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd1394f4-e8a3-4ea0-a6f5-6a1f146ce6f8 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:21.320758 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd1394f4-e8a3-4ea0-a6f5-6a1f146ce6f8 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:21.321193 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-cd1394f4-e8a3-4ea0-a6f5-6a1f146ce6f8 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:21.387931 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-cd1394f4-e8a3-4ea0-a6f5-6a1f146ce6f8 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:21.395398 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-cd1394f4-e8a3-4ea0-a6f5-6a1f146ce6f8 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1144 microversion: 2.1 time: 0.088506 Aug 01 14:19:21.395960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 598/1181] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:21 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:21.539510 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:21.540165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:21.547268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:21.547804 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:21.548603 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:21.549037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:21.656801 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a578e044-d619-42c7-93ef-0d2150901888 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:21.657656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a578e044-d619-42c7-93ef-0d2150901888 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:21.666215 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a578e044-d619-42c7-93ef-0d2150901888 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:21.666675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a578e044-d619-42c7-93ef-0d2150901888 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:21.667464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a578e044-d619-42c7-93ef-0d2150901888 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:21.667909 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a578e044-d619-42c7-93ef-0d2150901888 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:21.685731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:21.695483 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:21.697177 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:21.698441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a47728a-23ef-4345-b7b9-4a8e935be91e tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.163146 Aug 01 14:19:21.700514 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 584/1182] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:21 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:21.812759 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a578e044-d619-42c7-93ef-0d2150901888 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:21.820741 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a578e044-d619-42c7-93ef-0d2150901888 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.167827 Aug 01 14:19:21.821504 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 599/1183] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:21 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:22.415838 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e1f92808-cf67-485a-b56c-2b0079b68907 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:22.416561 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e1f92808-cf67-485a-b56c-2b0079b68907 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:22.422742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1f92808-cf67-485a-b56c-2b0079b68907 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:22.423183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1f92808-cf67-485a-b56c-2b0079b68907 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:22.423950 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1f92808-cf67-485a-b56c-2b0079b68907 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:22.424382 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e1f92808-cf67-485a-b56c-2b0079b68907 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:22.490589 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e1f92808-cf67-485a-b56c-2b0079b68907 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:22.498745 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e1f92808-cf67-485a-b56c-2b0079b68907 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1144 microversion: 2.1 time: 0.087450 Aug 01 14:19:22.500943 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 585/1184] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:22 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:22.721891 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:22.722646 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:22.730301 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:22.730747 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:22.731525 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:22.731961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:22.842251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-62ebdad3-d2b8-4447-a893-a4f829e30370 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:22.842945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-62ebdad3-d2b8-4447-a893-a4f829e30370 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:22.850408 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62ebdad3-d2b8-4447-a893-a4f829e30370 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:22.851372 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62ebdad3-d2b8-4447-a893-a4f829e30370 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:22.852316 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62ebdad3-d2b8-4447-a893-a4f829e30370 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:22.852616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-62ebdad3-d2b8-4447-a893-a4f829e30370 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:22.869961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:22.878784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:22.880289 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:22.881484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-12dae852-3544-48fe-97a4-3549c7764a41 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.163707 Aug 01 14:19:22.882463 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 600/1185] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:22 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:22.989727 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-62ebdad3-d2b8-4447-a893-a4f829e30370 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:22.997520 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-62ebdad3-d2b8-4447-a893-a4f829e30370 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.159348 Aug 01 14:19:22.998104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 586/1186] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:22 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:23.519189 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bac4b2d4-3d74-4864-bd55-bc6640c2c6ed tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:23.519797 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-bac4b2d4-3d74-4864-bd55-bc6640c2c6ed tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:23.526445 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bac4b2d4-3d74-4864-bd55-bc6640c2c6ed tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:23.526886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bac4b2d4-3d74-4864-bd55-bc6640c2c6ed tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:23.527630 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bac4b2d4-3d74-4864-bd55-bc6640c2c6ed tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:23.528060 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-bac4b2d4-3d74-4864-bd55-bc6640c2c6ed tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:23.602196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-bac4b2d4-3d74-4864-bd55-bc6640c2c6ed tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:23.609868 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bac4b2d4-3d74-4864-bd55-bc6640c2c6ed tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1144 microversion: 2.1 time: 0.094532 Aug 01 14:19:23.610454 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 601/1187] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:23 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1144 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:23.904204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:23.904864 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:23.911376 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:23.911824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:23.912616 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:23.913566 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:24.019157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a362ffa1-c9ff-4fc5-9b05-83728a06b778 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:24.019773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a362ffa1-c9ff-4fc5-9b05-83728a06b778 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:24.026329 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a362ffa1-c9ff-4fc5-9b05-83728a06b778 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:24.026772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a362ffa1-c9ff-4fc5-9b05-83728a06b778 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:24.027532 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a362ffa1-c9ff-4fc5-9b05-83728a06b778 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:24.027965 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a362ffa1-c9ff-4fc5-9b05-83728a06b778 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:24.031981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:24.043536 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:24.051460 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:24.052992 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:24.054793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dbc7d5af-91fc-4674-9ea4-fd5355c3cd89 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.154604 Aug 01 14:19:24.055351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 587/1188] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:23 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:24.158566 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-a362ffa1-c9ff-4fc5-9b05-83728a06b778 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:24.166579 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a362ffa1-c9ff-4fc5-9b05-83728a06b778 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.151375 Aug 01 14:19:24.167150 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 602/1189] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:24 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:24.631158 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-13128a38-3a67-45db-8cf5-66a12ec5db39 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:24.631773 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-13128a38-3a67-45db-8cf5-66a12ec5db39 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:24.637935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13128a38-3a67-45db-8cf5-66a12ec5db39 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:24.638385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13128a38-3a67-45db-8cf5-66a12ec5db39 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:24.639148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13128a38-3a67-45db-8cf5-66a12ec5db39 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:24.639585 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13128a38-3a67-45db-8cf5-66a12ec5db39 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:24.705365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-13128a38-3a67-45db-8cf5-66a12ec5db39 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:24.713708 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-13128a38-3a67-45db-8cf5-66a12ec5db39 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1144 microversion: 2.1 time: 0.086421 Aug 01 14:19:24.714293 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 588/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:24 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:25.079626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:25.080262 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:25.087722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.088171 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.088979 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.090285 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.188271 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5813c10c-2d00-4d12-b210-8ab8eb5c2edd tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:25.189010 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5813c10c-2d00-4d12-b210-8ab8eb5c2edd tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:25.196265 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5813c10c-2d00-4d12-b210-8ab8eb5c2edd tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.196739 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5813c10c-2d00-4d12-b210-8ab8eb5c2edd tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.197497 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5813c10c-2d00-4d12-b210-8ab8eb5c2edd tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.197924 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5813c10c-2d00-4d12-b210-8ab8eb5c2edd tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.221404 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:25.229416 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:25.230935 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:25.232102 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ec631fa9-a950-48fb-a030-975f7e283e48 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.157734 Aug 01 14:19:25.232948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 603/1191] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:25 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:25.580325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5813c10c-2d00-4d12-b210-8ab8eb5c2edd tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:25.587690 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5813c10c-2d00-4d12-b210-8ab8eb5c2edd tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.403246 Aug 01 14:19:25.588253 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 589/1192] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:25 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:25.734102 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-b719bf90-95a4-45ca-89e9-6aea01730356 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:25.734705 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-b719bf90-95a4-45ca-89e9-6aea01730356 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:25.741326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b719bf90-95a4-45ca-89e9-6aea01730356 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.741784 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b719bf90-95a4-45ca-89e9-6aea01730356 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.742540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b719bf90-95a4-45ca-89e9-6aea01730356 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:25.742971 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-b719bf90-95a4-45ca-89e9-6aea01730356 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:25.801360 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-b719bf90-95a4-45ca-89e9-6aea01730356 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:25.809446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-b719bf90-95a4-45ca-89e9-6aea01730356 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1144 microversion: 2.1 time: 0.079173 Aug 01 14:19:25.810000 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 604/1193] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:25 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1144 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:26.255511 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:26.256118 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:26.263669 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.264141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.264927 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.265368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.390128 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:26.398632 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:26.400157 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:26.401347 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d72a8b59-6744-4d36-b2c8-61f52ad3586d tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.149812 Aug 01 14:19:26.401941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 590/1194] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:26 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:26.609494 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ea13a7d3-ee39-4a06-95c1-111230b9f64d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:26.610079 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ea13a7d3-ee39-4a06-95c1-111230b9f64d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:26.617133 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ea13a7d3-ee39-4a06-95c1-111230b9f64d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.617581 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ea13a7d3-ee39-4a06-95c1-111230b9f64d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.618433 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ea13a7d3-ee39-4a06-95c1-111230b9f64d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.618870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ea13a7d3-ee39-4a06-95c1-111230b9f64d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.752717 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ea13a7d3-ee39-4a06-95c1-111230b9f64d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:26.764048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ea13a7d3-ee39-4a06-95c1-111230b9f64d tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.158559 Aug 01 14:19:26.764652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 605/1195] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:26 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:26.829349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4e12e465-8dab-4baa-863f-d954a5ff649e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:26.829962 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4e12e465-8dab-4baa-863f-d954a5ff649e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:26.835948 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e12e465-8dab-4baa-863f-d954a5ff649e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.836394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e12e465-8dab-4baa-863f-d954a5ff649e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.837187 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e12e465-8dab-4baa-863f-d954a5ff649e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:26.837623 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e12e465-8dab-4baa-863f-d954a5ff649e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:26.901197 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4e12e465-8dab-4baa-863f-d954a5ff649e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:26.908660 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4e12e465-8dab-4baa-863f-d954a5ff649e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1144 microversion: 2.1 time: 0.082980 Aug 01 14:19:26.909106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 591/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:26 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:27.425985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:27.426524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:27.432720 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:27.433173 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:27.433940 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:27.434377 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:27.566727 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:27.575609 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:27.577167 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:27.578326 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-81f71305-3b99-4e5f-b118-6302c62dfe31 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.156464 Aug 01 14:19:27.578889 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 606/1197] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:27 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:27.785376 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-00267f42-080a-4bae-ab6f-83e850f3af2c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:27.785918 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-00267f42-080a-4bae-ab6f-83e850f3af2c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:27.788224 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:27.794232 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00267f42-080a-4bae-ab6f-83e850f3af2c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:27.794698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00267f42-080a-4bae-ab6f-83e850f3af2c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:27.795441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00267f42-080a-4bae-ab6f-83e850f3af2c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:27.795875 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-00267f42-080a-4bae-ab6f-83e850f3af2c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:27.814321 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:27.925552 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-00267f42-080a-4bae-ab6f-83e850f3af2c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:27.930018 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-4114259a-697a-4384-bf4b-ecb2560759fa tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:27.930642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-4114259a-697a-4384-bf4b-ecb2560759fa tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:27.933478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-00267f42-080a-4bae-ab6f-83e850f3af2c tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.152002 Aug 01 14:19:27.934066 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 592/1198] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:27 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:27.937334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4114259a-697a-4384-bf4b-ecb2560759fa tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:27.937783 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4114259a-697a-4384-bf4b-ecb2560759fa tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:27.938551 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4114259a-697a-4384-bf4b-ecb2560759fa tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:27.939034 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-4114259a-697a-4384-bf4b-ecb2560759fa tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:28.000611 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-4114259a-697a-4384-bf4b-ecb2560759fa tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:28.009187 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-4114259a-697a-4384-bf4b-ecb2560759fa tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1136 microversion: 2.1 time: 0.083081 Aug 01 14:19:28.009751 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 607/1199] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:27 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:28.602203 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:28.602838 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:28.604677 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=8 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:28.610085 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:28.610536 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:28.611301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:28.611741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:28.796131 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:28.806995 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:28.808549 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:28.809731 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2cb0efc6-ff67-4d8e-8f48-cbb2c35442eb tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.212031 Aug 01 14:19:28.810596 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 593/1200] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:28 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:28.955024 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8b52641d-67a2-4b77-b9aa-9cce97d45a15 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:28.955644 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8b52641d-67a2-4b77-b9aa-9cce97d45a15 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:28.962761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8b52641d-67a2-4b77-b9aa-9cce97d45a15 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:28.963213 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8b52641d-67a2-4b77-b9aa-9cce97d45a15 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:28.964010 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8b52641d-67a2-4b77-b9aa-9cce97d45a15 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:28.964457 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8b52641d-67a2-4b77-b9aa-9cce97d45a15 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:29.030600 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5aee3fbe-c39a-4592-b824-dbbb41e1403f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:29.031322 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5aee3fbe-c39a-4592-b824-dbbb41e1403f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:29.037421 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5aee3fbe-c39a-4592-b824-dbbb41e1403f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:29.037960 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5aee3fbe-c39a-4592-b824-dbbb41e1403f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:29.038959 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5aee3fbe-c39a-4592-b824-dbbb41e1403f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:29.039994 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5aee3fbe-c39a-4592-b824-dbbb41e1403f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:29.097413 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8b52641d-67a2-4b77-b9aa-9cce97d45a15 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:29.101836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5aee3fbe-c39a-4592-b824-dbbb41e1403f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:29.105579 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8b52641d-67a2-4b77-b9aa-9cce97d45a15 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.154398 Aug 01 14:19:29.106158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 608/1201] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:28 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:29.110146 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5aee3fbe-c39a-4592-b824-dbbb41e1403f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1136 microversion: 2.1 time: 0.083607 Aug 01 14:19:29.110800 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 594/1202] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:29 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:29.833429 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:29.834040 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:29.840654 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:29.841129 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:29.841888 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:29.842325 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:29.979675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:29.987582 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:29.989118 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:29.990277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6fd299b3-1fb5-43fc-9e6f-271ec814e390 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.160763 Aug 01 14:19:29.990836 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 609/1203] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:29 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:30.127552 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-35f12d84-9131-42b2-b82d-8a397d8fa44f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:30.128115 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-35f12d84-9131-42b2-b82d-8a397d8fa44f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:30.131164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-173b0d38-13de-435c-b6f1-4d778f76f874 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:30.131856 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-173b0d38-13de-435c-b6f1-4d778f76f874 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:30.135391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35f12d84-9131-42b2-b82d-8a397d8fa44f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:30.135839 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35f12d84-9131-42b2-b82d-8a397d8fa44f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:30.136637 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35f12d84-9131-42b2-b82d-8a397d8fa44f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:30.137385 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35f12d84-9131-42b2-b82d-8a397d8fa44f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:30.138714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-173b0d38-13de-435c-b6f1-4d778f76f874 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:30.139222 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-173b0d38-13de-435c-b6f1-4d778f76f874 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:30.140310 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-173b0d38-13de-435c-b6f1-4d778f76f874 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:30.140656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-173b0d38-13de-435c-b6f1-4d778f76f874 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:30.211350 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-173b0d38-13de-435c-b6f1-4d778f76f874 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:30.220750 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-173b0d38-13de-435c-b6f1-4d778f76f874 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1200 microversion: 2.1 time: 0.093514 Aug 01 14:19:30.221770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 610/1204] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:30 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:30.277864 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-35f12d84-9131-42b2-b82d-8a397d8fa44f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:30.285652 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-35f12d84-9131-42b2-b82d-8a397d8fa44f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.162294 Aug 01 14:19:30.286981 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 595/1205] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:30 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:31.012786 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:31.013484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:31.019842 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:31.020288 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:31.021074 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:31.021501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:31.147541 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:31.155916 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:31.157442 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:31.158581 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5967b684-9e5b-4213-8c98-6396863c807b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.149961 Aug 01 14:19:31.159130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 611/1206] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:31 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:31.241850 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ade8d250-861e-420b-bef9-a38d415832c6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:31.242465 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ade8d250-861e-420b-bef9-a38d415832c6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:31.248946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ade8d250-861e-420b-bef9-a38d415832c6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:31.249397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ade8d250-861e-420b-bef9-a38d415832c6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:31.250792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ade8d250-861e-420b-bef9-a38d415832c6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:31.252221 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ade8d250-861e-420b-bef9-a38d415832c6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:31.307344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d697bbcf-fd33-4688-9f7d-db3fcd80b11b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:31.308225 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d697bbcf-fd33-4688-9f7d-db3fcd80b11b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:31.323145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d697bbcf-fd33-4688-9f7d-db3fcd80b11b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:31.323690 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d697bbcf-fd33-4688-9f7d-db3fcd80b11b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:31.324506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d697bbcf-fd33-4688-9f7d-db3fcd80b11b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:31.324948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d697bbcf-fd33-4688-9f7d-db3fcd80b11b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:31.342346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ade8d250-861e-420b-bef9-a38d415832c6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:31.350672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ade8d250-861e-420b-bef9-a38d415832c6 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1210 microversion: 2.1 time: 0.112577 Aug 01 14:19:31.351256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 596/1207] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:31 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:31.461790 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d697bbcf-fd33-4688-9f7d-db3fcd80b11b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:31.470000 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d697bbcf-fd33-4688-9f7d-db3fcd80b11b tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1575 microversion: 2.1 time: 0.166786 Aug 01 14:19:31.470578 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 612/1208] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:31 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:32.183108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:32.183824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:32.190308 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:32.190759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:32.191528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:32.191971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:32.240765 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-50b8a8cd-4ebb-439e-85c6-d3c08f461dc4 req-e492b9e4-07d1-41a3-95d5-32a3cf98be69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900b90f4-dd21-4df9-a880-5760f2c62ae5", "name": "network-vif-plugged", "status": "completed", "tag": "27822eab-07c3-4ba4-b4e4-e82eaa97336f"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:32.256135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-50b8a8cd-4ebb-439e-85c6-d3c08f461dc4 req-e492b9e4-07d1-41a3-95d5-32a3cf98be69 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:32.256938 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-50b8a8cd-4ebb-439e-85c6-d3c08f461dc4 req-e492b9e4-07d1-41a3-95d5-32a3cf98be69 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:32.271553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-50b8a8cd-4ebb-439e-85c6-d3c08f461dc4 req-e492b9e4-07d1-41a3-95d5-32a3cf98be69 service nova] Creating event network-vif-plugged:27822eab-07c3-4ba4-b4e4-e82eaa97336f for instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 on hv-cinder-84713 Aug 01 14:19:32.277241 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-50b8a8cd-4ebb-439e-85c6-d3c08f461dc4 req-e492b9e4-07d1-41a3-95d5-32a3cf98be69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041899 Aug 01 14:19:32.278890 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 613/1209] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:19:32.342362 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:32.350372 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:32.351873 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:32.353671 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cb1a84bf-a227-4b26-a440-2d392df8ab14 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.175179 Aug 01 14:19:32.354388 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 597/1210] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:32 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:32.376779 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3f6de66f-3875-4a4a-9093-143c94430f66 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:32.377479 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3f6de66f-3875-4a4a-9093-143c94430f66 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:32.384628 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f6de66f-3875-4a4a-9093-143c94430f66 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:32.385065 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f6de66f-3875-4a4a-9093-143c94430f66 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:32.385840 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f6de66f-3875-4a4a-9093-143c94430f66 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:32.386407 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3f6de66f-3875-4a4a-9093-143c94430f66 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:32.492749 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f9a9668e-719b-4508-9f4b-23ebfd50a7f9 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:32.494066 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f9a9668e-719b-4508-9f4b-23ebfd50a7f9 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:32.514590 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f9a9668e-719b-4508-9f4b-23ebfd50a7f9 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:32.515051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f9a9668e-719b-4508-9f4b-23ebfd50a7f9 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:32.515852 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f9a9668e-719b-4508-9f4b-23ebfd50a7f9 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:32.520116 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f9a9668e-719b-4508-9f4b-23ebfd50a7f9 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:32.548036 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3f6de66f-3875-4a4a-9093-143c94430f66 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:32.556978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3f6de66f-3875-4a4a-9093-143c94430f66 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1278 microversion: 2.1 time: 0.185678 Aug 01 14:19:32.558480 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 614/1211] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:32 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1278 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:32.793967 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f9a9668e-719b-4508-9f4b-23ebfd50a7f9 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:32.804213 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f9a9668e-719b-4508-9f4b-23ebfd50a7f9 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1562 microversion: 2.1 time: 0.315172 Aug 01 14:19:32.804999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 598/1212] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:32 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1562 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:33.178197 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-5f31944a-408c-416d-a444-77a1ab43d0b1 req-0d9e2fce-dc48-44e3-ad82-636392c0e223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8dc70d-8222-40b1-a2cf-a38869ab56a8", "tag": "3cf51f68-6ca3-4a80-89a9-544c48237810"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:33.187678 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-5f31944a-408c-416d-a444-77a1ab43d0b1 req-0d9e2fce-dc48-44e3-ad82-636392c0e223 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:33.188128 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-5f31944a-408c-416d-a444-77a1ab43d0b1 req-0d9e2fce-dc48-44e3-ad82-636392c0e223 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:33.199895 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-5f31944a-408c-416d-a444-77a1ab43d0b1 req-0d9e2fce-dc48-44e3-ad82-636392c0e223 service nova] Creating event network-changed:3cf51f68-6ca3-4a80-89a9-544c48237810 for instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 on hv-cinder-84713 Aug 01 14:19:33.204802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-5f31944a-408c-416d-a444-77a1ab43d0b1 req-0d9e2fce-dc48-44e3-ad82-636392c0e223 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030141 Aug 01 14:19:33.205427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 615/1213] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:19:33.381819 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:33.382434 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:33.389593 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:33.390049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:33.390815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:33.391255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:33.534483 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:33.542531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:33.544051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:33.545236 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4af10f30-78d3-49cc-be12-a54a2aad8873 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.167372 Aug 01 14:19:33.545793 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 599/1214] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:33 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:19:33.579136 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ee8bb3d8-3108-4d8e-892d-3d2516161c1a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:33.579839 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ee8bb3d8-3108-4d8e-892d-3d2516161c1a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:33.586047 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ee8bb3d8-3108-4d8e-892d-3d2516161c1a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:33.586495 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ee8bb3d8-3108-4d8e-892d-3d2516161c1a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:33.587253 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ee8bb3d8-3108-4d8e-892d-3d2516161c1a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:33.587688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ee8bb3d8-3108-4d8e-892d-3d2516161c1a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:33.721132 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ee8bb3d8-3108-4d8e-892d-3d2516161c1a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:33.729131 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ee8bb3d8-3108-4d8e-892d-3d2516161c1a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.154577 Aug 01 14:19:33.729674 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 616/1215] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:33 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:34.568913 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:34.570277 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:34.579028 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:34.579922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:34.580856 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:34.581372 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:34.732603 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:34.748114 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:34.749749 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:34.749938 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-002e6a23-e4d4-48cd-8757-be68ab084d1e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:34.750911 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-002e6a23-e4d4-48cd-8757-be68ab084d1e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:34.751006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fe4b7055-60d6-434e-a021-7612b17247d3 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1730 microversion: 2.20 time: 0.187058 Aug 01 14:19:34.759513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 600/1216] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:34 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:34.759968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-002e6a23-e4d4-48cd-8757-be68ab084d1e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:34.759968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-002e6a23-e4d4-48cd-8757-be68ab084d1e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:34.759968 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-002e6a23-e4d4-48cd-8757-be68ab084d1e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:34.760213 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-002e6a23-e4d4-48cd-8757-be68ab084d1e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:34.907748 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-002e6a23-e4d4-48cd-8757-be68ab084d1e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:34.915503 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-002e6a23-e4d4-48cd-8757-be68ab084d1e tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.169466 Aug 01 14:19:34.916154 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 617/1217] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:34 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:35.775170 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:35.775787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:35.782346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:35.782799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:35.783562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:35.784003 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:35.913906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:35.921729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:35.923227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:35.924372 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0e2c9414-995e-409e-af45-a16c67898b71 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1717 microversion: 2.20 time: 0.153882 Aug 01 14:19:35.924956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 601/1218] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:19:35 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:19:35.935064 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-dbb9ad3e-7d48-47c2-9611-f7dd2f2189b0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:35.935684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-dbb9ad3e-7d48-47c2-9611-f7dd2f2189b0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:35.942501 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dbb9ad3e-7d48-47c2-9611-f7dd2f2189b0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:35.942947 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dbb9ad3e-7d48-47c2-9611-f7dd2f2189b0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:35.943710 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dbb9ad3e-7d48-47c2-9611-f7dd2f2189b0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:35.944144 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-dbb9ad3e-7d48-47c2-9611-f7dd2f2189b0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:36.073500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-dbb9ad3e-7d48-47c2-9611-f7dd2f2189b0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:36.080906 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-dbb9ad3e-7d48-47c2-9611-f7dd2f2189b0 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.149595 Aug 01 14:19:36.081736 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 618/1219] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:35 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:37.102535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-301c803b-91d1-4bc2-bea5-5e407f9827c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:37.103152 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-301c803b-91d1-4bc2-bea5-5e407f9827c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:37.109587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-301c803b-91d1-4bc2-bea5-5e407f9827c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:37.110031 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-301c803b-91d1-4bc2-bea5-5e407f9827c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:37.110781 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-301c803b-91d1-4bc2-bea5-5e407f9827c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:37.111210 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-301c803b-91d1-4bc2-bea5-5e407f9827c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:37.239786 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-301c803b-91d1-4bc2-bea5-5e407f9827c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:37.247344 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-301c803b-91d1-4bc2-bea5-5e407f9827c1 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.149273 Aug 01 14:19:37.247918 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 602/1220] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:37 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:38.267183 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-415aeff6-0032-43ea-95f0-07bae44fa13f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:38.267840 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-415aeff6-0032-43ea-95f0-07bae44fa13f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:38.274435 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-415aeff6-0032-43ea-95f0-07bae44fa13f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:38.274887 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-415aeff6-0032-43ea-95f0-07bae44fa13f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:38.275656 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-415aeff6-0032-43ea-95f0-07bae44fa13f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:38.276098 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-415aeff6-0032-43ea-95f0-07bae44fa13f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:38.406152 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-415aeff6-0032-43ea-95f0-07bae44fa13f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:38.413418 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-415aeff6-0032-43ea-95f0-07bae44fa13f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.150093 Aug 01 14:19:38.413973 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 619/1221] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:38 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:39.435251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b9a6f65d-5b4b-442a-916a-0684109968ab tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:39.435876 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b9a6f65d-5b4b-442a-916a-0684109968ab tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:39.442856 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9a6f65d-5b4b-442a-916a-0684109968ab tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:39.443306 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9a6f65d-5b4b-442a-916a-0684109968ab tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:39.444067 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9a6f65d-5b4b-442a-916a-0684109968ab tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:39.444542 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9a6f65d-5b4b-442a-916a-0684109968ab tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:39.576532 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b9a6f65d-5b4b-442a-916a-0684109968ab tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:39.584108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b9a6f65d-5b4b-442a-916a-0684109968ab tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.153389 Aug 01 14:19:39.584710 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 603/1222] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:39 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:40.606005 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ec1e2815-09d8-4853-8153-2598faa12560 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:40.606599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ec1e2815-09d8-4853-8153-2598faa12560 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:40.613340 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ec1e2815-09d8-4853-8153-2598faa12560 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:40.613808 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ec1e2815-09d8-4853-8153-2598faa12560 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:40.614561 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ec1e2815-09d8-4853-8153-2598faa12560 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:40.615043 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ec1e2815-09d8-4853-8153-2598faa12560 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:40.617703 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=100 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:40.744302 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ec1e2815-09d8-4853-8153-2598faa12560 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:40.751712 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ec1e2815-09d8-4853-8153-2598faa12560 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.150018 Aug 01 14:19:40.752277 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 620/1223] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:40 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:41.773097 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a716c659-0b79-40bf-a49c-c795dd4d26ec tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:41.773706 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a716c659-0b79-40bf-a49c-c795dd4d26ec tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:41.780301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a716c659-0b79-40bf-a49c-c795dd4d26ec tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:41.780777 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a716c659-0b79-40bf-a49c-c795dd4d26ec tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:41.781536 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a716c659-0b79-40bf-a49c-c795dd4d26ec tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:41.781970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a716c659-0b79-40bf-a49c-c795dd4d26ec tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:41.911302 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a716c659-0b79-40bf-a49c-c795dd4d26ec tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:41.918615 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a716c659-0b79-40bf-a49c-c795dd4d26ec tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.149651 Aug 01 14:19:41.919177 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 604/1224] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:41 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:42.939892 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8365d449-cf45-414d-aa9f-3fbe228cec9f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:42.940561 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8365d449-cf45-414d-aa9f-3fbe228cec9f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:42.943145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=66 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:19:42.949101 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8365d449-cf45-414d-aa9f-3fbe228cec9f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:42.949630 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8365d449-cf45-414d-aa9f-3fbe228cec9f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:42.950433 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8365d449-cf45-414d-aa9f-3fbe228cec9f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:42.950928 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8365d449-cf45-414d-aa9f-3fbe228cec9f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:43.101616 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-8365d449-cf45-414d-aa9f-3fbe228cec9f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:43.109752 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8365d449-cf45-414d-aa9f-3fbe228cec9f tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.174259 Aug 01 14:19:43.110322 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 621/1225] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:42 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:44.130143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-408bed9f-b9c5-4246-aa71-c4848e467f60 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:44.130696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-408bed9f-b9c5-4246-aa71-c4848e467f60 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:44.137261 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-408bed9f-b9c5-4246-aa71-c4848e467f60 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:44.137703 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-408bed9f-b9c5-4246-aa71-c4848e467f60 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:44.138522 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-408bed9f-b9c5-4246-aa71-c4848e467f60 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:44.139044 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-408bed9f-b9c5-4246-aa71-c4848e467f60 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:44.292906 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-408bed9f-b9c5-4246-aa71-c4848e467f60 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:44.303167 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-408bed9f-b9c5-4246-aa71-c4848e467f60 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.176506 Aug 01 14:19:44.306018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 605/1226] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:44 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:45.329451 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d05fe80a-5127-4b13-82b0-bc721fddf7c9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:45.329991 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d05fe80a-5127-4b13-82b0-bc721fddf7c9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:45.336338 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d05fe80a-5127-4b13-82b0-bc721fddf7c9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:45.336819 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d05fe80a-5127-4b13-82b0-bc721fddf7c9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:45.337608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d05fe80a-5127-4b13-82b0-bc721fddf7c9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:45.338045 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d05fe80a-5127-4b13-82b0-bc721fddf7c9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:45.479157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d05fe80a-5127-4b13-82b0-bc721fddf7c9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:45.486653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d05fe80a-5127-4b13-82b0-bc721fddf7c9 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.161365 Aug 01 14:19:45.487216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 622/1227] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:45 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:46.327993 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-564e1a12-57bd-4596-b8ff-7e5fe59c202d req-0409d06a-6462-40c5-954c-89f566a861e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8dc70d-8222-40b1-a2cf-a38869ab56a8", "name": "network-vif-plugged", "status": "completed", "tag": "3cf51f68-6ca3-4a80-89a9-544c48237810"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:46.344027 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-564e1a12-57bd-4596-b8ff-7e5fe59c202d req-0409d06a-6462-40c5-954c-89f566a861e8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:46.344759 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-564e1a12-57bd-4596-b8ff-7e5fe59c202d req-0409d06a-6462-40c5-954c-89f566a861e8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:46.357162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-564e1a12-57bd-4596-b8ff-7e5fe59c202d req-0409d06a-6462-40c5-954c-89f566a861e8 service nova] Creating event network-vif-plugged:3cf51f68-6ca3-4a80-89a9-544c48237810 for instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 on hv-cinder-84713 Aug 01 14:19:46.362248 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-564e1a12-57bd-4596-b8ff-7e5fe59c202d req-0409d06a-6462-40c5-954c-89f566a861e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043208 Aug 01 14:19:46.362846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 606/1228] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:19:46.507838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-28f93ff9-20f3-4b5d-ad7e-34f804ffb772 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:46.508401 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-28f93ff9-20f3-4b5d-ad7e-34f804ffb772 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:46.515575 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28f93ff9-20f3-4b5d-ad7e-34f804ffb772 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:46.516017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28f93ff9-20f3-4b5d-ad7e-34f804ffb772 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:46.516805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28f93ff9-20f3-4b5d-ad7e-34f804ffb772 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:46.517243 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-28f93ff9-20f3-4b5d-ad7e-34f804ffb772 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:46.670473 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-28f93ff9-20f3-4b5d-ad7e-34f804ffb772 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:46.679529 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-28f93ff9-20f3-4b5d-ad7e-34f804ffb772 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.175719 Aug 01 14:19:46.680245 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 623/1229] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:46 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:47.702916 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-043d6fac-f21f-44d2-baa8-3166fd5d1d04 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:47.703621 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-043d6fac-f21f-44d2-baa8-3166fd5d1d04 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:47.710155 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-043d6fac-f21f-44d2-baa8-3166fd5d1d04 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:47.710605 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-043d6fac-f21f-44d2-baa8-3166fd5d1d04 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:47.711368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-043d6fac-f21f-44d2-baa8-3166fd5d1d04 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:47.711805 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-043d6fac-f21f-44d2-baa8-3166fd5d1d04 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:47.846315 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-043d6fac-f21f-44d2-baa8-3166fd5d1d04 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:47.854432 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-043d6fac-f21f-44d2-baa8-3166fd5d1d04 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1266 microversion: 2.1 time: 0.156244 Aug 01 14:19:47.855002 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 607/1230] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:47 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:48.875012 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-d18723b9-a698-4e4a-8fb5-6502f9ff74dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:48.875634 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-d18723b9-a698-4e4a-8fb5-6502f9ff74dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:48.882281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d18723b9-a698-4e4a-8fb5-6502f9ff74dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.882675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d18723b9-a698-4e4a-8fb5-6502f9ff74dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:48.883440 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d18723b9-a698-4e4a-8fb5-6502f9ff74dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:48.883881 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-d18723b9-a698-4e4a-8fb5-6502f9ff74dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:49.022001 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-d18723b9-a698-4e4a-8fb5-6502f9ff74dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:49.029645 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-d18723b9-a698-4e4a-8fb5-6502f9ff74dc tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1452 microversion: 2.1 time: 0.158515 Aug 01 14:19:49.030224 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 624/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:48 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:19:49.049585 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be7051be-cb2e-461b-8673-a05dbbac5e4b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:19:49.050193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be7051be-cb2e-461b-8673-a05dbbac5e4b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:19:49.057298 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be7051be-cb2e-461b-8673-a05dbbac5e4b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:49.057768 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be7051be-cb2e-461b-8673-a05dbbac5e4b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:49.058529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be7051be-cb2e-461b-8673-a05dbbac5e4b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:49.058958 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be7051be-cb2e-461b-8673-a05dbbac5e4b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:49.195866 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be7051be-cb2e-461b-8673-a05dbbac5e4b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:19:49.203971 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be7051be-cb2e-461b-8673-a05dbbac5e4b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1452 microversion: 2.1 time: 0.158240 Aug 01 14:19:49.204559 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 608/1232] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:19:49 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:19:51.122018 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-77dfb22b-ff1a-43ea-8d0c-d236d0a09e27 req-c85f71d1-b231-4fb1-892f-b945ea0ecc5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8dc70d-8222-40b1-a2cf-a38869ab56a8", "tag": "3cf51f68-6ca3-4a80-89a9-544c48237810"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:19:51.132566 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-77dfb22b-ff1a-43ea-8d0c-d236d0a09e27 req-c85f71d1-b231-4fb1-892f-b945ea0ecc5e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:19:51.133120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-77dfb22b-ff1a-43ea-8d0c-d236d0a09e27 req-c85f71d1-b231-4fb1-892f-b945ea0ecc5e service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:19:51.146361 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-77dfb22b-ff1a-43ea-8d0c-d236d0a09e27 req-c85f71d1-b231-4fb1-892f-b945ea0ecc5e service nova] Creating event network-changed:3cf51f68-6ca3-4a80-89a9-544c48237810 for instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 on hv-cinder-84713 Aug 01 14:19:51.151804 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-77dfb22b-ff1a-43ea-8d0c-d236d0a09e27 req-c85f71d1-b231-4fb1-892f-b945ea0ecc5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034007 Aug 01 14:19:51.152625 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 625/1233] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:25.439486 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2e8e5cfb-9c17-4157-a219-c05cc33b0194 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:25.440141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2e8e5cfb-9c17-4157-a219-c05cc33b0194 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:25.442162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=53 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:25.442830 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=94 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:25.448718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e8e5cfb-9c17-4157-a219-c05cc33b0194 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:25.449171 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e8e5cfb-9c17-4157-a219-c05cc33b0194 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:25.449940 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e8e5cfb-9c17-4157-a219-c05cc33b0194 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:25.450378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e8e5cfb-9c17-4157-a219-c05cc33b0194 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:25.475376 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2e8e5cfb-9c17-4157-a219-c05cc33b0194 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/ips" status: 200 len: 144 microversion: 2.1 time: 0.040172 Aug 01 14:20:25.475954 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 609/1234] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:20:25 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/ips => generated 144 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:26.790484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=9 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:26.791850 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=31 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:26.796553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-93191ffb-d8c6-447b-818c-448c9689ca8a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc26e4de-5281-41bf-8958-336d4fe85a7a"}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:26.799091 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-93191ffb-d8c6-447b-818c-448c9689ca8a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:26.806886 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93191ffb-d8c6-447b-818c-448c9689ca8a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:26.807903 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93191ffb-d8c6-447b-818c-448c9689ca8a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:26.808716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93191ffb-d8c6-447b-818c-448c9689ca8a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:26.809155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-93191ffb-d8c6-447b-818c-448c9689ca8a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:27.075950 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-93191ffb-d8c6-447b-818c-448c9689ca8a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286967 Aug 01 14:20:27.076800 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 626/1235] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:20:26 2022] POST /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:35.650854 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-54f50284-b5e8-49b8-a3c8-393d954296fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:35.653013 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-54f50284-b5e8-49b8-a3c8-393d954296fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:35.655501 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:35.656140 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:35.661868 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54f50284-b5e8-49b8-a3c8-393d954296fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:35.662312 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54f50284-b5e8-49b8-a3c8-393d954296fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:35.663061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54f50284-b5e8-49b8-a3c8-393d954296fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:35.663488 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54f50284-b5e8-49b8-a3c8-393d954296fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:35.692635 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-54f50284-b5e8-49b8-a3c8-393d954296fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046054 Aug 01 14:20:35.693186 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 610/1236] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:20:35 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:35.705234 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9fe86a83-878b-4121-b203-a93426d10b6d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:35.705830 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9fe86a83-878b-4121-b203-a93426d10b6d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:35.712081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9fe86a83-878b-4121-b203-a93426d10b6d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:35.713461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9fe86a83-878b-4121-b203-a93426d10b6d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:35.714236 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9fe86a83-878b-4121-b203-a93426d10b6d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:35.714689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9fe86a83-878b-4121-b203-a93426d10b6d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:35.742471 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9fe86a83-878b-4121-b203-a93426d10b6d tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/cc26e4de-5281-41bf-8958-336d4fe85a7a" status: 200 len: 194 microversion: 2.1 time: 0.042082 Aug 01 14:20:35.743048 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 627/1237] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 14:20:35 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/cc26e4de-5281-41bf-8958-336d4fe85a7a => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:37.086928 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2f0da08-3e11-4dc1-a6bf-088566e0e44e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab07117f-c563-485e-84cc-e91d7a6d545e"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:37.089772 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e2f0da08-3e11-4dc1-a6bf-088566e0e44e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:37.096238 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2f0da08-3e11-4dc1-a6bf-088566e0e44e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:37.096758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2f0da08-3e11-4dc1-a6bf-088566e0e44e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:37.097580 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2f0da08-3e11-4dc1-a6bf-088566e0e44e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:37.098035 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2f0da08-3e11-4dc1-a6bf-088566e0e44e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:37.375649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e2f0da08-3e11-4dc1-a6bf-088566e0e44e tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "POST /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292767 Aug 01 14:20:37.380531 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 611/1238] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:20:37 2022] POST /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:41.628162 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7dac492c-ce3a-43ab-b1b8-f9f3cca5a8fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:41.628714 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7dac492c-ce3a-43ab-b1b8-f9f3cca5a8fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:41.635237 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7dac492c-ce3a-43ab-b1b8-f9f3cca5a8fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:41.635695 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7dac492c-ce3a-43ab-b1b8-f9f3cca5a8fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:41.636467 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7dac492c-ce3a-43ab-b1b8-f9f3cca5a8fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:41.636930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7dac492c-ce3a-43ab-b1b8-f9f3cca5a8fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:41.660073 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7dac492c-ce3a-43ab-b1b8-f9f3cca5a8fd tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/ips" status: 200 len: 149 microversion: 2.1 time: 0.035847 Aug 01 14:20:41.660668 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 628/1239] 10.222.0.48 () {58 vars in 1248 bytes} [Mon Aug 1 14:20:41 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:42.985834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-04071ff3-9309-421a-a439-a5611fddafc0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77d429e4-6327-48e2-9ac4-98529bab10c9"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:42.988335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-04071ff3-9309-421a-a439-a5611fddafc0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:42.994635 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04071ff3-9309-421a-a439-a5611fddafc0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:42.995086 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04071ff3-9309-421a-a439-a5611fddafc0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:42.995860 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04071ff3-9309-421a-a439-a5611fddafc0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:42.996295 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04071ff3-9309-421a-a439-a5611fddafc0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:43.253662 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-04071ff3-9309-421a-a439-a5611fddafc0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "POST /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272409 Aug 01 14:20:43.254297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 612/1240] 10.222.0.48 () {60 vars in 1323 bytes} [Mon Aug 1 14:20:42 2022] POST /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments => generated 194 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:44.216780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:20:44.217652 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Mon Aug 1 14:20:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:20:45.966540 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ea51ee93-f76d-4a30-9d39-c5b58df3ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:45.968798 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ea51ee93-f76d-4a30-9d39-c5b58df3ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:45.975302 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ea51ee93-f76d-4a30-9d39-c5b58df3ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:45.975757 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ea51ee93-f76d-4a30-9d39-c5b58df3ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:45.976574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ea51ee93-f76d-4a30-9d39-c5b58df3ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:45.977021 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ea51ee93-f76d-4a30-9d39-c5b58df3ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.007448 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ea51ee93-f76d-4a30-9d39-c5b58df3ecd7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044815 Aug 01 14:20:46.008283 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 629/1241] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:20:45 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:46.162256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1e3a30de-7187-42de-aaaf-7fb6255665bd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:46.162837 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1e3a30de-7187-42de-aaaf-7fb6255665bd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:46.169076 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e3a30de-7187-42de-aaaf-7fb6255665bd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.169517 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e3a30de-7187-42de-aaaf-7fb6255665bd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.170268 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e3a30de-7187-42de-aaaf-7fb6255665bd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.170702 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1e3a30de-7187-42de-aaaf-7fb6255665bd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.205135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1e3a30de-7187-42de-aaaf-7fb6255665bd tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/cc26e4de-5281-41bf-8958-336d4fe85a7a" status: 200 len: 194 microversion: 2.1 time: 0.047748 Aug 01 14:20:46.205726 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 613/1242] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 14:20:46 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/cc26e4de-5281-41bf-8958-336d4fe85a7a => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:46.216020 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fcbc19c4-6f2f-475e-8f42-aad44dd281e5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:46.216544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fcbc19c4-6f2f-475e-8f42-aad44dd281e5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:46.222472 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fcbc19c4-6f2f-475e-8f42-aad44dd281e5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.222925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fcbc19c4-6f2f-475e-8f42-aad44dd281e5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.223688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fcbc19c4-6f2f-475e-8f42-aad44dd281e5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:46.224130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fcbc19c4-6f2f-475e-8f42-aad44dd281e5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:46.302574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-fcbc19c4-6f2f-475e-8f42-aad44dd281e5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lazy-loading 'services' on Instance uuid 48a8a080-a34d-4ba9-8131-f502e8a54ff4 {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:20:46.376296 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fcbc19c4-6f2f-475e-8f42-aad44dd281e5 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/cc26e4de-5281-41bf-8958-336d4fe85a7a" status: 202 len: 0 microversion: 2.1 time: 0.164072 Aug 01 14:20:46.376938 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 630/1243] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:20:46 2022] DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/cc26e4de-5281-41bf-8958-336d4fe85a7a => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:20:52.598912 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c1b3aad4-907d-4a12-9e7b-1fe83dac30af tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:52.601132 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c1b3aad4-907d-4a12-9e7b-1fe83dac30af tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:52.608589 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1b3aad4-907d-4a12-9e7b-1fe83dac30af tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.609056 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1b3aad4-907d-4a12-9e7b-1fe83dac30af tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.609851 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1b3aad4-907d-4a12-9e7b-1fe83dac30af tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.610279 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1b3aad4-907d-4a12-9e7b-1fe83dac30af tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.638335 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c1b3aad4-907d-4a12-9e7b-1fe83dac30af tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043452 Aug 01 14:20:52.638895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 614/1244] 10.222.0.48 () {60 vars in 1343 bytes} [Mon Aug 1 14:20:52 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:52.702406 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8377a6da-de38-4c03-9f13-b501c118c548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:52.703005 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8377a6da-de38-4c03-9f13-b501c118c548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:52.709258 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8377a6da-de38-4c03-9f13-b501c118c548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.709712 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8377a6da-de38-4c03-9f13-b501c118c548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.710478 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8377a6da-de38-4c03-9f13-b501c118c548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.710918 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8377a6da-de38-4c03-9f13-b501c118c548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.736567 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8377a6da-de38-4c03-9f13-b501c118c548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:20:52.816752 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8377a6da-de38-4c03-9f13-b501c118c548 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "DELETE /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 204 len: 0 microversion: 2.20 time: 0.118512 Aug 01 14:20:52.817737 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 631/1245] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 14:20:52 2022] DELETE /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:20:52.827655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:52.828331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:52.834699 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.835141 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.835894 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:52.836325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:52.981338 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.989486 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.991108 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:52.992326 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-709b12c6-6648-451c-a2d2-d8492599c963 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.168823 Aug 01 14:20:52.992976 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 615/1246] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:52 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:53.003820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7bdeea45-7fe7-4656-95bb-e4d9abc2c682 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:53.004517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7bdeea45-7fe7-4656-95bb-e4d9abc2c682 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.011251 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bdeea45-7fe7-4656-95bb-e4d9abc2c682 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.011703 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bdeea45-7fe7-4656-95bb-e4d9abc2c682 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.012490 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bdeea45-7fe7-4656-95bb-e4d9abc2c682 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.012942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7bdeea45-7fe7-4656-95bb-e4d9abc2c682 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.094969 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-7bdeea45-7fe7-4656-95bb-e4d9abc2c682 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lazy-loading 'services' on Instance uuid b3639d3f-a4f5-49b1-bd17-26c44c0113ba {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:20:53.165443 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7bdeea45-7fe7-4656-95bb-e4d9abc2c682 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments/77d429e4-6327-48e2-9ac4-98529bab10c9" status: 202 len: 0 microversion: 2.1 time: 0.165728 Aug 01 14:20:53.166028 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 632/1247] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:20:52 2022] DELETE /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments/77d429e4-6327-48e2-9ac4-98529bab10c9 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:20:53.174252 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0f11b949-1797-4146-8367-930c4fdbb18f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:53.176494 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0f11b949-1797-4146-8367-930c4fdbb18f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:53.182555 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f11b949-1797-4146-8367-930c4fdbb18f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.183162 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f11b949-1797-4146-8367-930c4fdbb18f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.183990 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f11b949-1797-4146-8367-930c4fdbb18f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:53.184421 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f11b949-1797-4146-8367-930c4fdbb18f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:53.213913 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0f11b949-1797-4146-8367-930c4fdbb18f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043580 Aug 01 14:20:53.214466 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 616/1248] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:20:53 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:54.016456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.017186 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.023733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.024181 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.024984 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.025450 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.167010 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.175044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.176585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:54.177781 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e3f3712a-4ea1-4072-82d5-23a28ee5dcf9 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.166281 Aug 01 14:20:54.178366 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 633/1249] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:54 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:54.226165 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f8117e91-8ae8-4735-a7f9-57abd6185a5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.229037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f8117e91-8ae8-4735-a7f9-57abd6185a5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.239340 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8117e91-8ae8-4735-a7f9-57abd6185a5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.239790 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8117e91-8ae8-4735-a7f9-57abd6185a5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.240592 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8117e91-8ae8-4735-a7f9-57abd6185a5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.241036 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8117e91-8ae8-4735-a7f9-57abd6185a5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.269521 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f8117e91-8ae8-4735-a7f9-57abd6185a5f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047233 Aug 01 14:20:54.270082 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 617/1250] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:20:54 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:54.894073 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e91f70a8-d821-41a9-bf35-d4eb252a2448 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.894571 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e91f70a8-d821-41a9-bf35-d4eb252a2448 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.900680 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e91f70a8-d821-41a9-bf35-d4eb252a2448 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.901138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e91f70a8-d821-41a9-bf35-d4eb252a2448 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.901899 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e91f70a8-d821-41a9-bf35-d4eb252a2448 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.902340 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e91f70a8-d821-41a9-bf35-d4eb252a2448 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.932155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e91f70a8-d821-41a9-bf35-d4eb252a2448 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/ab07117f-c563-485e-84cc-e91d7a6d545e" status: 200 len: 194 microversion: 2.1 time: 0.042003 Aug 01 14:20:54.932708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 634/1251] 10.222.0.48 () {58 vars in 1413 bytes} [Mon Aug 1 14:20:54 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/ab07117f-c563-485e-84cc-e91d7a6d545e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:54.943449 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d079e18c-48c8-4ecc-b88f-6b60d2f482a7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:54.943934 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d079e18c-48c8-4ecc-b88f-6b60d2f482a7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:54.950443 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d079e18c-48c8-4ecc-b88f-6b60d2f482a7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.950883 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d079e18c-48c8-4ecc-b88f-6b60d2f482a7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:54.951632 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d079e18c-48c8-4ecc-b88f-6b60d2f482a7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:54.952060 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d079e18c-48c8-4ecc-b88f-6b60d2f482a7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.033835 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-d079e18c-48c8-4ecc-b88f-6b60d2f482a7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lazy-loading 'services' on Instance uuid 48a8a080-a34d-4ba9-8131-f502e8a54ff4 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:20:55.109700 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d079e18c-48c8-4ecc-b88f-6b60d2f482a7 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/ab07117f-c563-485e-84cc-e91d7a6d545e" status: 202 len: 0 microversion: 2.1 time: 0.169985 Aug 01 14:20:55.110512 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 618/1252] 10.222.0.48 () {58 vars in 1416 bytes} [Mon Aug 1 14:20:54 2022] DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments/ab07117f-c563-485e-84cc-e91d7a6d545e => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:20:55.200994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:55.201622 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:55.209251 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.209742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.210571 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.211044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.285711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a189e8df-552f-4c62-b342-bc2f3f3b1762 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:55.289051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a189e8df-552f-4c62-b342-bc2f3f3b1762 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:55.300859 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a189e8df-552f-4c62-b342-bc2f3f3b1762 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.301650 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a189e8df-552f-4c62-b342-bc2f3f3b1762 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.302436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a189e8df-552f-4c62-b342-bc2f3f3b1762 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:55.302909 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a189e8df-552f-4c62-b342-bc2f3f3b1762 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:55.336386 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a189e8df-552f-4c62-b342-bc2f3f3b1762 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057606 Aug 01 14:20:55.337595 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 619/1253] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:20:55 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:55.363975 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.373190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.374785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:55.376049 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-5b734395-9d1c-49f5-b47c-043caaeebc10 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1723 microversion: 2.20 time: 0.178921 Aug 01 14:20:55.376705 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 635/1254] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:55 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:56.167088 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-9efe0d2f-d591-4d12-af7e-c8f8b5b62fbd req-51f28d83-abcf-4c0d-84a1-6cd226b4e315 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900b90f4-dd21-4df9-a880-5760f2c62ae5", "name": "network-vif-deleted", "tag": "27822eab-07c3-4ba4-b4e4-e82eaa97336f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:20:56.178911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9efe0d2f-d591-4d12-af7e-c8f8b5b62fbd req-51f28d83-abcf-4c0d-84a1-6cd226b4e315 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.179457 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9efe0d2f-d591-4d12-af7e-c8f8b5b62fbd req-51f28d83-abcf-4c0d-84a1-6cd226b4e315 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.200256 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-9efe0d2f-d591-4d12-af7e-c8f8b5b62fbd req-51f28d83-abcf-4c0d-84a1-6cd226b4e315 service nova] Creating event network-vif-deleted:27822eab-07c3-4ba4-b4e4-e82eaa97336f for instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 on hv-cinder-84713 Aug 01 14:20:56.207266 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-9efe0d2f-d591-4d12-af7e-c8f8b5b62fbd req-51f28d83-abcf-4c0d-84a1-6cd226b4e315 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124856 Aug 01 14:20:56.208935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 620/1255] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:20:56.350510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-511d330b-af7b-40a0-8b5b-cafba7b7c347 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.354120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-511d330b-af7b-40a0-8b5b-cafba7b7c347 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.360954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-511d330b-af7b-40a0-8b5b-cafba7b7c347 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.361410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-511d330b-af7b-40a0-8b5b-cafba7b7c347 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.362195 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-511d330b-af7b-40a0-8b5b-cafba7b7c347 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.362642 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-511d330b-af7b-40a0-8b5b-cafba7b7c347 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.391265 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-511d330b-af7b-40a0-8b5b-cafba7b7c347 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046357 Aug 01 14:20:56.391887 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 636/1256] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:20:56.401887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.404212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.411979 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.412670 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.413528 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.414041 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.448124 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.448695 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.449698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lazy-loading 'fault' on Instance uuid 900b90f4-dd21-4df9-a880-5760f2c62ae5 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:20:56.456158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7be3ef1f-0c24-4bae-a7e3-f6c9274df1c3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.456694 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7be3ef1f-0c24-4bae-a7e3-f6c9274df1c3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.464770 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7be3ef1f-0c24-4bae-a7e3-f6c9274df1c3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.465385 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7be3ef1f-0c24-4bae-a7e3-f6c9274df1c3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.466371 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7be3ef1f-0c24-4bae-a7e3-f6c9274df1c3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.466999 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7be3ef1f-0c24-4bae-a7e3-f6c9274df1c3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.493533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.498666 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7be3ef1f-0c24-4bae-a7e3-f6c9274df1c3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:20:56.502127 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.503651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.507179 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a68977c6-2c0c-428d-ab64-e56ded89c7dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1371 microversion: 2.20 time: 0.111763 Aug 01 14:20:56.521055 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 621/1257] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1371 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 01 14:20:56.529801 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:56.599506 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7be3ef1f-0c24-4bae-a7e3-f6c9274df1c3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 204 len: 0 microversion: 2.1 time: 0.146559 Aug 01 14:20:56.600418 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 637/1258] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:20:56 2022] DELETE /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:20:56.609963 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-90db1fbd-24f3-400a-88e5-ac801a49b80d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:56.610685 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-90db1fbd-24f3-400a-88e5-ac801a49b80d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:56.616893 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-90db1fbd-24f3-400a-88e5-ac801a49b80d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.617458 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-90db1fbd-24f3-400a-88e5-ac801a49b80d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.618255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-90db1fbd-24f3-400a-88e5-ac801a49b80d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:56.618690 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-90db1fbd-24f3-400a-88e5-ac801a49b80d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:56.768105 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-90db1fbd-24f3-400a-88e5-ac801a49b80d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:56.776406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-90db1fbd-24f3-400a-88e5-ac801a49b80d tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1681 microversion: 2.1 time: 0.170460 Aug 01 14:20:56.777014 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 622/1259] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:56 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:57.366509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1eb9edbf-7cc7-4e8f-a291-e5595771060a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.369267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1eb9edbf-7cc7-4e8f-a291-e5595771060a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.371625 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:57.377807 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1eb9edbf-7cc7-4e8f-a291-e5595771060a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.378257 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1eb9edbf-7cc7-4e8f-a291-e5595771060a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.379033 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1eb9edbf-7cc7-4e8f-a291-e5595771060a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.379470 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1eb9edbf-7cc7-4e8f-a291-e5595771060a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.411364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1eb9edbf-7cc7-4e8f-a291-e5595771060a tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049130 Aug 01 14:20:57.411919 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 638/1260] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:20:57.527756 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7477fa3b-746a-49d0-bcd2-30644970111c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.530135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7477fa3b-746a-49d0-bcd2-30644970111c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.531956 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.532697 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.537191 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7477fa3b-746a-49d0-bcd2-30644970111c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.537644 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7477fa3b-746a-49d0-bcd2-30644970111c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.538421 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7477fa3b-746a-49d0-bcd2-30644970111c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.538859 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7477fa3b-746a-49d0-bcd2-30644970111c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.538992 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.540216 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.541017 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.541447 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.558695 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:57.575301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7477fa3b-746a-49d0-bcd2-30644970111c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051740 Aug 01 14:20:57.575892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 623/1261] 10.222.0.48 () {58 vars in 1302 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 01 14:20:57.576756 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.577203 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.577650 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lazy-loading 'fault' on Instance uuid 900b90f4-dd21-4df9-a880-5760f2c62ae5 {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:20:57.626385 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.634700 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.636359 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '62cc969defd64837a20e9a7dbda5b4fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d4402cabc4b41e0aec0ccc40cdd17cc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.637648 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9e0bbf1e-90fe-4d9a-8349-46f993ecbc2b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 200 len: 1371 microversion: 2.20 time: 0.109565 Aug 01 14:20:57.638275 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 639/1262] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 01 14:20:57.641078 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dd9a985f-fded-4d50-98f8-45891f008df4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.641577 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dd9a985f-fded-4d50-98f8-45891f008df4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.647527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd9a985f-fded-4d50-98f8-45891f008df4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.647973 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd9a985f-fded-4d50-98f8-45891f008df4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.648792 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd9a985f-fded-4d50-98f8-45891f008df4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.649228 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd9a985f-fded-4d50-98f8-45891f008df4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.674149 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dd9a985f-fded-4d50-98f8-45891f008df4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:20:57.752299 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dd9a985f-fded-4d50-98f8-45891f008df4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 204 len: 0 microversion: 2.1 time: 0.115227 Aug 01 14:20:57.752904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 624/1263] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:20:57 2022] DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 01 14:20:57.761015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-51aee095-04dc-4895-ab8a-66358cc0f711 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.761668 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-51aee095-04dc-4895-ab8a-66358cc0f711 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.767606 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51aee095-04dc-4895-ab8a-66358cc0f711 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.768064 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51aee095-04dc-4895-ab8a-66358cc0f711 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.768870 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51aee095-04dc-4895-ab8a-66358cc0f711 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.769313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-51aee095-04dc-4895-ab8a-66358cc0f711 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.798533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b0898785-74ad-47fa-811e-aaf3e0312b96 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:57.799334 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b0898785-74ad-47fa-811e-aaf3e0312b96 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:57.807051 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0898785-74ad-47fa-811e-aaf3e0312b96 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.807587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0898785-74ad-47fa-811e-aaf3e0312b96 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.808507 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0898785-74ad-47fa-811e-aaf3e0312b96 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:57.809008 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0898785-74ad-47fa-811e-aaf3e0312b96 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:57.922116 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-51aee095-04dc-4895-ab8a-66358cc0f711 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.932065 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-51aee095-04dc-4895-ab8a-66358cc0f711 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1671 microversion: 2.1 time: 0.174753 Aug 01 14:20:57.934315 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 640/1264] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1671 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:57.953672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b0898785-74ad-47fa-811e-aaf3e0312b96 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:57.962815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b0898785-74ad-47fa-811e-aaf3e0312b96 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1681 microversion: 2.1 time: 0.168813 Aug 01 14:20:57.963584 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 625/1265] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:57 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:20:58.660589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:58.661288 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:58.667978 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.668524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.669456 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.669763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.684230 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] HTTP exception thrown: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Request method failure captured: Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 HTTP/1.1 Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi596Dv3VBRbS4bp33CX1l3gzP2Ydck9kFaMkQkbm6YyXFxhtxuFz4GjlWOEEYXCzZRh4NL5QCFLEvw5BEnqWY5oYV_HaRAgNkQuEfR7Am6Y2GkZoi4nSKgpvMU65ffnmdccoTeUKzlz1PQ_mIbmUOM1w8mkP1zk4KgE0dhr2JX38tt6A Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:20:58.686163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}] Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 62cc969defd64837a20e9a7dbda5b4fa Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:20:58.687872 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '900b90f4-dd21-4df9-a880-5760f2c62ae5'} Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:20:58.688871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:20:58.690419 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:20:58.691757 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Returning 404 to user: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:20:58.691757 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fefa6a8e-be96-4b8d-9265-1944f6b3b8df tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 404 len: 111 microversion: 2.20 time: 0.030956 Aug 01 14:20:58.691757 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 641/1266] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:20:58 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:20:58.697923 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-907516a8-8a7d-4042-806c-1227d9c20692 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '.version_select at 0x7f4462c323a0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:58.716988 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-907516a8-8a7d-4042-806c-1227d9c20692 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838398321" status: 204 len: 0 microversion: 2.20 time: 0.023690 Aug 01 14:20:58.717533 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 626/1267] 10.222.0.48 () {60 vars in 1262 bytes} [Mon Aug 1 14:20:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1838398321 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 01 14:20:58.955512 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9872a579-0b11-41ae-abfe-38f4803502db tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:58.956139 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9872a579-0b11-41ae-abfe-38f4803502db tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:58.964687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9872a579-0b11-41ae-abfe-38f4803502db tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.965304 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9872a579-0b11-41ae-abfe-38f4803502db tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.966086 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9872a579-0b11-41ae-abfe-38f4803502db tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.966549 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9872a579-0b11-41ae-abfe-38f4803502db tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.985526 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-89b312c4-38ea-4253-a960-ccdf61b8a367 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:20:58.988882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-89b312c4-38ea-4253-a960-ccdf61b8a367 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:20:58.998354 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89b312c4-38ea-4253-a960-ccdf61b8a367 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:58.999562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89b312c4-38ea-4253-a960-ccdf61b8a367 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:58.999705 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89b312c4-38ea-4253-a960-ccdf61b8a367 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:20:59.000148 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89b312c4-38ea-4253-a960-ccdf61b8a367 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:20:59.133696 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-89b312c4-38ea-4253-a960-ccdf61b8a367 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.141255 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-89b312c4-38ea-4253-a960-ccdf61b8a367 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1681 microversion: 2.1 time: 0.159771 Aug 01 14:20:59.141828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 627/1268] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:58 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:20:59.201629 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9872a579-0b11-41ae-abfe-38f4803502db tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:20:59.209585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9872a579-0b11-41ae-abfe-38f4803502db tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1671 microversion: 2.1 time: 0.258052 Aug 01 14:20:59.210083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 642/1269] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:20:58 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1671 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:00.163089 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1d5ae8b7-a511-4a32-a740-fc2533f84a78 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.163842 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1d5ae8b7-a511-4a32-a740-fc2533f84a78 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:00.170665 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8b7-a511-4a32-a740-fc2533f84a78 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.171160 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8b7-a511-4a32-a740-fc2533f84a78 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.171992 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8b7-a511-4a32-a740-fc2533f84a78 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.172492 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d5ae8b7-a511-4a32-a740-fc2533f84a78 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.230296 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e0ca5ac3-3464-4065-97e9-51b7a51a190b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.230917 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e0ca5ac3-3464-4065-97e9-51b7a51a190b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:00.237838 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e0ca5ac3-3464-4065-97e9-51b7a51a190b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.238300 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e0ca5ac3-3464-4065-97e9-51b7a51a190b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.239145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e0ca5ac3-3464-4065-97e9-51b7a51a190b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.239589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e0ca5ac3-3464-4065-97e9-51b7a51a190b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.369860 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e0ca5ac3-3464-4065-97e9-51b7a51a190b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.379204 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e0ca5ac3-3464-4065-97e9-51b7a51a190b tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1671 microversion: 2.1 time: 0.152720 Aug 01 14:21:00.379803 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 643/1270] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:00 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:21:00.501381 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1d5ae8b7-a511-4a32-a740-fc2533f84a78 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:00.509104 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1d5ae8b7-a511-4a32-a740-fc2533f84a78 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1681 microversion: 2.1 time: 0.349981 Aug 01 14:21:00.509684 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 628/1271] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:00 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1681 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:00.612932 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.613439 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:00.620219 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.620759 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.621640 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.622092 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.635357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] HTTP exception thrown: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Request method failure captured: Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 HTTP/1.1 Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi596Dv3VBRbS4bp33CX1l3gzP2Ydck9kFaMkQkbm6YyXFxhtxuFz4GjlWOEEYXCzZRh4NL5QCFLEvw5BEnqWY5oYV_HaRAgNkQuEfR7Am6Y2GkZoi4nSKgpvMU65ffnmdccoTeUKzlz1PQ_mIbmUOM1w8mkP1zk4KgE0dhr2JX38tt6A Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:00.636961 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}] Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 62cc969defd64837a20e9a7dbda5b4fa Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.638626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '900b90f4-dd21-4df9-a880-5760f2c62ae5'} Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:00.639500 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.640954 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.642948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Returning 404 to user: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:00.642948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-778395ca-c185-4548-aa6c-08eb11ce78e5 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "DELETE /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 404 len: 111 microversion: 2.20 time: 0.029765 Aug 01 14:21:00.642948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 644/1272] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 14:21:00 2022] DELETE /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:21:00.646972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:00.647672 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 900b90f4-dd21-4df9-a880-5760f2c62ae5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:00.653784 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.654231 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.655006 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:00.655439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:00.669849 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] HTTP exception thrown: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Request method failure captured: Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 HTTP/1.1 Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi596Dv3VBRbS4bp33CX1l3gzP2Ydck9kFaMkQkbm6YyXFxhtxuFz4GjlWOEEYXCzZRh4NL5QCFLEvw5BEnqWY5oYV_HaRAgNkQuEfR7Am6Y2GkZoi4nSKgpvMU65ffnmdccoTeUKzlz1PQ_mIbmUOM1w8mkP1zk4KgE0dhr2JX38tt6A Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:00.671598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}] Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 62cc969defd64837a20e9a7dbda5b4fa Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.673012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '900b90f4-dd21-4df9-a880-5760f2c62ae5'} Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:00.673887 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. Aug 01 14:21:00.675935 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:00.677323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Returning 404 to user: Instance 900b90f4-dd21-4df9-a880-5760f2c62ae5 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:00.677323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c72b6edb-e882-4f6c-af71-37c119594d4b tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5" status: 404 len: 111 microversion: 2.20 time: 0.030189 Aug 01 14:21:00.677323 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 629/1273] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:00 2022] GET /compute/v2.1/servers/900b90f4-dd21-4df9-a880-5760f2c62ae5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 14:21:01.402170 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-87a8b29b-44fd-48cd-a946-29ef2e89ec67 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:01.402790 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-87a8b29b-44fd-48cd-a946-29ef2e89ec67 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.409288 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-87a8b29b-44fd-48cd-a946-29ef2e89ec67 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.409742 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-87a8b29b-44fd-48cd-a946-29ef2e89ec67 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.410509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-87a8b29b-44fd-48cd-a946-29ef2e89ec67 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.410952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-87a8b29b-44fd-48cd-a946-29ef2e89ec67 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.479209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-87a8b29b-44fd-48cd-a946-29ef2e89ec67 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.487910 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-87a8b29b-44fd-48cd-a946-29ef2e89ec67 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1604 microversion: 2.1 time: 0.090242 Aug 01 14:21:01.488593 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 645/1274] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:01 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1604 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:01.530828 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-19c05809-e77e-49f5-b9fa-579cac9647b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:01.531492 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-19c05809-e77e-49f5-b9fa-579cac9647b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.538217 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19c05809-e77e-49f5-b9fa-579cac9647b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.539017 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19c05809-e77e-49f5-b9fa-579cac9647b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.539765 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19c05809-e77e-49f5-b9fa-579cac9647b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.540365 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19c05809-e77e-49f5-b9fa-579cac9647b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.621922 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-19c05809-e77e-49f5-b9fa-579cac9647b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:01.630862 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-19c05809-e77e-49f5-b9fa-579cac9647b4 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1613 microversion: 2.1 time: 0.103807 Aug 01 14:21:01.631391 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 630/1275] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:01 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1613 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:01.836541 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:01.837371 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.845573 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.846519 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.847513 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.847960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.871209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] HTTP exception thrown: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Request method failure captured: Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf HTTP/1.1 Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi596Dv3VBRbS4bp33CX1l3gzP2Ydck9kFaMkQkbm6YyXFxhtxuFz4GjlWOEEYXCzZRh4NL5QCFLEvw5BEnqWY5oYV_HaRAgNkQuEfR7Am6Y2GkZoi4nSKgpvMU65ffnmdccoTeUKzlz1PQ_mIbmUOM1w8mkP1zk4KgE0dhr2JX38tt6A Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:01.873313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}] Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 62cc969defd64837a20e9a7dbda5b4fa Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.874925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '51fd7ad6-9939-4561-b0fa-f45f8602eccf'} Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:01.875667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.877041 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.881160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Returning 404 to user: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:01.883362 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7db45e30-597e-42d9-8dfe-906bafa6b9c0 tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "DELETE /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 404 len: 111 microversion: 2.20 time: 0.050953 Aug 01 14:21:01.884524 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 646/1276] 10.222.0.48 () {60 vars in 1280 bytes} [Mon Aug 1 14:21:01 2022] DELETE /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 01 14:21:01.895189 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:01.895820 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] [instance: 51fd7ad6-9939-4561-b0fa-f45f8602eccf] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:01.912741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.914175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-c27cc6bd-e6ba-4346-8f90-ebeaa3ed6f13 req-88efedd4-7768-45ef-a36d-091f9fa903db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3639d3f-a4f5-49b1-bd17-26c44c0113ba", "name": "network-vif-deleted", "tag": "ad876c77-136b-4537-bd94-96619059c312"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:01.915834 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.916804 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.917260 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.938426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] HTTP exception thrown: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Request method failure captured: Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf HTTP/1.1 Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi596Dv3VBRbS4bp33CX1l3gzP2Ydck9kFaMkQkbm6YyXFxhtxuFz4GjlWOEEYXCzZRh4NL5QCFLEvw5BEnqWY5oYV_HaRAgNkQuEfR7Am6Y2GkZoi4nSKgpvMU65ffnmdccoTeUKzlz1PQ_mIbmUOM1w8mkP1zk4KgE0dhr2JX38tt6A Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:01.940301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6d4402cabc4b41e0aec0ccc40cdd17cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6d4402cabc4b41e0aec0ccc40cdd17cc"}]}] Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 6d4402cabc4b41e0aec0ccc40cdd17cc Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1678626567 Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 62cc969defd64837a20e9a7dbda5b4fa Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1678626567-project Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.941817 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '51fd7ad6-9939-4561-b0fa-f45f8602eccf'} Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:01.942666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. Aug 01 14:21:01.943871 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:01.945327 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-c27cc6bd-e6ba-4346-8f90-ebeaa3ed6f13 req-88efedd4-7768-45ef-a36d-091f9fa903db service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:01.945327 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-c27cc6bd-e6ba-4346-8f90-ebeaa3ed6f13 req-88efedd4-7768-45ef-a36d-091f9fa903db service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:01.952622 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] Returning 404 to user: Instance 51fd7ad6-9939-4561-b0fa-f45f8602eccf could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:01.961517 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-19ca0e18-a164-496a-b826-e29893aab0dd tempest-AttachVolumeShelveTestJSON-1678626567 tempest-AttachVolumeShelveTestJSON-1678626567-project] 10.222.0.48 "GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf" status: 404 len: 111 microversion: 2.20 time: 0.072906 Aug 01 14:21:01.962103 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 631/1277] 10.222.0.48 () {60 vars in 1277 bytes} [Mon Aug 1 14:21:01 2022] GET /compute/v2.1/servers/51fd7ad6-9939-4561-b0fa-f45f8602eccf => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 01 14:21:01.970775 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-c27cc6bd-e6ba-4346-8f90-ebeaa3ed6f13 req-88efedd4-7768-45ef-a36d-091f9fa903db service nova] Creating event network-vif-deleted:ad876c77-136b-4537-bd94-96619059c312 for instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba on hv-cinder-84713 Aug 01 14:21:01.977617 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-c27cc6bd-e6ba-4346-8f90-ebeaa3ed6f13 req-88efedd4-7768-45ef-a36d-091f9fa903db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069812 Aug 01 14:21:01.978227 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 647/1278] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:02.510037 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:02.510964 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:02.518304 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.518982 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.519919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.520529 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.556889 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.557961 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.558598 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lazy-loading 'fault' on Instance uuid 48a8a080-a34d-4ba9-8131-f502e8a54ff4 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:21:02.609546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe4b3455a3d4139a1267da97bd83662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3d2b7b0783c4cc7bd0ce59a13f70efa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:02.618107 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2e3dddf4-0d9c-48f0-8c87-ed8d169c93a4 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 200 len: 1327 microversion: 2.1 time: 0.112443 Aug 01 14:21:02.618919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 632/1279] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:02 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:02.655051 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:02.656552 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:02.662915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.663564 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.664628 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.665240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.721684 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:02.722628 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:02.723424 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lazy-loading 'fault' on Instance uuid b3639d3f-a4f5-49b1-bd17-26c44c0113ba {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:21:02.794905 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca3cd1c2aec94b43aff0034b812a069d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3203f080a05422e83090a1f0a31d1a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:02.814332 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-30a6d34b-fa17-496b-b9d8-d98fa24d3615 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 200 len: 1331 microversion: 2.1 time: 0.163177 Aug 01 14:21:02.816295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 648/1280] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:02 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 1331 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:03.639737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:03.640327 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:03.647050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.647502 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.648345 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.648837 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.662705 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] HTTP exception thrown: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Request method failure captured: Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 HTTP/1.1 Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi597pxyUzUD2HaRyYpTAij644BdXRpcMuppXM3MGNd5GVAN1gKfmyppngGgw2V2KmfZ4jHOChvGPQHHMIkxwc8SKdDgHwOb_aWxBxKMznQ0mkSvVQHh_g9JzhiIU4oSCHl9Lan3kQ7p-IbiGibkSe5BwH2B1chcJES154xCECr3G9v_8 Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:03.664301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}] Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ebe4b3455a3d4139a1267da97bd83662 Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:03.665892 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '48a8a080-a34d-4ba9-8131-f502e8a54ff4'} Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:03.666787 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:03.668367 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.670093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Returning 404 to user: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:03.670093 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-34c1299a-5029-4076-9627-57f79a574f7c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 404 len: 111 microversion: 2.1 time: 0.030012 Aug 01 14:21:03.674460 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-bbd25494-6d50-44c9-a303-e78d5b38b360 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '.version_select at 0x7f4462e9b430>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:03.679554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 633/1281] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:03 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:03.697598 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-bbd25494-6d50-44c9-a303-e78d5b38b360 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-762115004" status: 202 len: 0 microversion: 2.1 time: 0.026758 Aug 01 14:21:03.698103 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 649/1282] 10.222.0.48 () {58 vars in 1218 bytes} [Mon Aug 1 14:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-762115004 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 01 14:21:03.841378 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:03.841978 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:03.849774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.850697 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.852816 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:03.853659 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:03.874090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba HTTP/1.1 Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:03.876441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:03.878025 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'b3639d3f-a4f5-49b1-bd17-26c44c0113ba'} Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:03.879021 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:03.880394 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:03.883286 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:03.884298 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c742ad08-ceb9-439a-ad65-dd84fe017ea2 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 404 len: 111 microversion: 2.1 time: 0.047426 Aug 01 14:21:03.885699 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 634/1283] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:03 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:03.894387 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-6d43786a-c3c8-43c5-9222-2b7f7277aca8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '.version_select at 0x7f4462e52b80>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:03.919768 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-6d43786a-c3c8-43c5-9222-2b7f7277aca8 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745021518" status: 202 len: 0 microversion: 2.1 time: 0.029497 Aug 01 14:21:03.920613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 650/1284] 10.222.0.48 () {58 vars in 1221 bytes} [Mon Aug 1 14:21:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745021518 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:21:04.066379 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-e9595b66-e952-42f0-90b3-5bbade91721c req-e4752006-c4da-4f9e-95c8-fe20d61f86b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48a8a080-a34d-4ba9-8131-f502e8a54ff4", "name": "network-vif-deleted", "tag": "bf39acbe-27ee-4f84-a849-b6d623845fab"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:04.076807 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-e9595b66-e952-42f0-90b3-5bbade91721c req-e4752006-c4da-4f9e-95c8-fe20d61f86b8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:04.077556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-e9595b66-e952-42f0-90b3-5bbade91721c req-e4752006-c4da-4f9e-95c8-fe20d61f86b8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:04.096413 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-e9595b66-e952-42f0-90b3-5bbade91721c req-e4752006-c4da-4f9e-95c8-fe20d61f86b8 service nova] Creating event network-vif-deleted:bf39acbe-27ee-4f84-a849-b6d623845fab for instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 on hv-cinder-84713 Aug 01 14:21:04.103328 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-e9595b66-e952-42f0-90b3-5bbade91721c req-e4752006-c4da-4f9e-95c8-fe20d61f86b8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041219 Aug 01 14:21:04.104463 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 635/1285] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:06.252321 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.252911 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.260155 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.260711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.261471 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.261901 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.276523 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba HTTP/1.1 Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:06.278190 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.279763 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': 'b3639d3f-a4f5-49b1-bd17-26c44c0113ba'} Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:06.280948 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.282160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.283427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:06.283427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-262847a7-905c-41c7-9445-4c1b6626ba6f tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 404 len: 111 microversion: 2.1 time: 0.031412 Aug 01 14:21:06.283427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 651/1286] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:06 2022] DELETE /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:06.289673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:06.290490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: b3639d3f-a4f5-49b1-bd17-26c44c0113ba] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:06.293235 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:06.299997 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.300600 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.301439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:06.301945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:06.317100 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba HTTP/1.1 Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:06.318741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.320741 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'b3639d3f-a4f5-49b1-bd17-26c44c0113ba'} Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:06.321655 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. Aug 01 14:21:06.322987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:06.324142 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance b3639d3f-a4f5-49b1-bd17-26c44c0113ba could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:06.324142 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-254d4d2e-417e-48f2-b154-e18af177d7ba tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba" status: 404 len: 111 microversion: 2.1 time: 0.035661 Aug 01 14:21:06.324142 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 636/1287] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:06 2022] GET /compute/v2.1/servers/b3639d3f-a4f5-49b1-bd17-26c44c0113ba => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:07.165916 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.166414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.172613 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.173071 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.173840 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.174428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.191623 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] HTTP exception thrown: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Request method failure captured: Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 HTTP/1.1 Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi597pxyUzUD2HaRyYpTAij644BdXRpcMuppXM3MGNd5GVAN1gKfmyppngGgw2V2KmfZ4jHOChvGPQHHMIkxwc8SKdDgHwOb_aWxBxKMznQ0mkSvVQHh_g9JzhiIU4oSCHl9Lan3kQ7p-IbiGibkSe5BwH2B1chcJES154xCECr3G9v_8 Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:07.193240 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}] Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: ebe4b3455a3d4139a1267da97bd83662 Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.195410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '48a8a080-a34d-4ba9-8131-f502e8a54ff4'} Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:07.196610 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.198080 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.199491 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Returning 404 to user: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:07.199491 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-64a1f8be-bf22-4ea9-948d-37eb23eb1f95 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 404 len: 111 microversion: 2.1 time: 0.032898 Aug 01 14:21:07.199491 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 652/1288] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:07 2022] DELETE /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:07.203707 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.204350 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 48a8a080-a34d-4ba9-8131-f502e8a54ff4] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.211049 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.211503 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.212308 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.212779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.227849 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] HTTP exception thrown: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Request method failure captured: Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 HTTP/1.1 Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi597pxyUzUD2HaRyYpTAij644BdXRpcMuppXM3MGNd5GVAN1gKfmyppngGgw2V2KmfZ4jHOChvGPQHHMIkxwc8SKdDgHwOb_aWxBxKMznQ0mkSvVQHh_g9JzhiIU4oSCHl9Lan3kQ7p-IbiGibkSe5BwH2B1chcJES154xCECr3G9v_8 Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:07.229513 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}] Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ebe4b3455a3d4139a1267da97bd83662 Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.231130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '48a8a080-a34d-4ba9-8131-f502e8a54ff4'} Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:07.231946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. Aug 01 14:21:07.233193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.234319 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Returning 404 to user: Instance 48a8a080-a34d-4ba9-8131-f502e8a54ff4 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:07.234319 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e35a7984-3538-412a-bcd5-78abae6af130 tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4" status: 404 len: 111 microversion: 2.1 time: 0.031163 Aug 01 14:21:07.234319 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 637/1289] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:07 2022] GET /compute/v2.1/servers/48a8a080-a34d-4ba9-8131-f502e8a54ff4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:21:07.464957 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.465543 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.472302 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.472636 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.473410 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.473853 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.487335 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f HTTP/1.1 Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:07.488915 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.490299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': 'a0a6965a-e41a-44e6-8317-3a420f00e98f'} Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:07.494570 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.495805 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.497081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:07.497081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-21c43efb-17dd-45b1-9c2e-a1151c893fa0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 404 len: 111 microversion: 2.1 time: 0.029273 Aug 01 14:21:07.497081 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 653/1290] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:07 2022] DELETE /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 01 14:21:07.502281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.502895 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: a0a6965a-e41a-44e6-8317-3a420f00e98f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.510122 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.510570 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.511346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.511783 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.525273 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f HTTP/1.1 Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:07.526919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.528240 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'a0a6965a-e41a-44e6-8317-3a420f00e98f'} Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:07.529022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. Aug 01 14:21:07.530799 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.532584 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance a0a6965a-e41a-44e6-8317-3a420f00e98f could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:07.532584 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9541b5ff-cd96-456e-9ace-409b95336ee0 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f" status: 404 len: 111 microversion: 2.1 time: 0.029810 Aug 01 14:21:07.532584 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 638/1291] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:07 2022] GET /compute/v2.1/servers/a0a6965a-e41a-44e6-8317-3a420f00e98f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:07.536772 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.537272 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.543409 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.543861 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.544655 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.545104 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.559558 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 HTTP/1.1 Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:07.561526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.563120 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '98847e8e-92b8-46b9-bb66-3b374c9a81b0'} Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:07.564044 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.565509 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.566985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:07.566985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-91e415fa-594d-4f81-b4cf-e758e1eb5b44 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 404 len: 111 microversion: 2.1 time: 0.029945 Aug 01 14:21:07.566985 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 654/1292] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:07 2022] DELETE /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:07.573090 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:07.573721 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 98847e8e-92b8-46b9-bb66-3b374c9a81b0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:07.579790 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.580242 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.581048 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:07.581490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:07.596216 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 HTTP/1.1 Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:07.597863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.599426 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '98847e8e-92b8-46b9-bb66-3b374c9a81b0'} Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:07.600325 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. Aug 01 14:21:07.602692 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:07.604091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance 98847e8e-92b8-46b9-bb66-3b374c9a81b0 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:07.604091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4a77c9a0-7ea0-4bc5-a6a3-707f15e5c06a tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0" status: 404 len: 111 microversion: 2.1 time: 0.031542 Aug 01 14:21:07.604091 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 639/1293] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:07 2022] GET /compute/v2.1/servers/98847e8e-92b8-46b9-bb66-3b374c9a81b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:08.373899 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:08.374334 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:08.380285 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.380761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.381526 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.381964 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.395166 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] HTTP exception thrown: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Request method failure captured: Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 HTTP/1.1 Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi597pxyUzUD2HaRyYpTAij644BdXRpcMuppXM3MGNd5GVAN1gKfmyppngGgw2V2KmfZ4jHOChvGPQHHMIkxwc8SKdDgHwOb_aWxBxKMznQ0mkSvVQHh_g9JzhiIU4oSCHl9Lan3kQ7p-IbiGibkSe5BwH2B1chcJES154xCECr3G9v_8 Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:08.396718 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}] Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: ebe4b3455a3d4139a1267da97bd83662 Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.398370 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '7eb60b84-0a48-4c71-90d0-bb0ad32e66a3'} Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:08.399143 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.400553 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.401967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Returning 404 to user: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:08.401967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-7ac289af-9278-4eda-94a3-ced1228d55fe tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 404 len: 111 microversion: 2.1 time: 0.028171 Aug 01 14:21:08.401967 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 655/1294] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:08 2022] DELETE /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:08.406227 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:08.406836 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] [instance: 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:08.412987 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.413943 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.414737 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.415224 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.428573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] HTTP exception thrown: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Request method failure captured: Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 HTTP/1.1 Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi597pxyUzUD2HaRyYpTAij644BdXRpcMuppXM3MGNd5GVAN1gKfmyppngGgw2V2KmfZ4jHOChvGPQHHMIkxwc8SKdDgHwOb_aWxBxKMznQ0mkSvVQHh_g9JzhiIU4oSCHl9Lan3kQ7p-IbiGibkSe5BwH2B1chcJES154xCECr3G9v_8 Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:08.430758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c3d2b7b0783c4cc7bd0ce59a13f70efa"}]}] Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c3d2b7b0783c4cc7bd0ce59a13f70efa Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1593121249 Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ebe4b3455a3d4139a1267da97bd83662 Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-1593121249-project Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.432991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '7eb60b84-0a48-4c71-90d0-bb0ad32e66a3'} Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:08.434193 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. Aug 01 14:21:08.436911 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.438262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] Returning 404 to user: Instance 7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:08.438262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d8ac43bb-4297-4233-9352-79e96105ec3c tempest-AttachVolumeTestJSON-1593121249 tempest-AttachVolumeTestJSON-1593121249-project] 10.222.0.48 "GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3" status: 404 len: 111 microversion: 2.1 time: 0.030536 Aug 01 14:21:08.438262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 640/1295] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:08 2022] GET /compute/v2.1/servers/7eb60b84-0a48-4c71-90d0-bb0ad32e66a3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:08.744733 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:08.745239 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:08.751723 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.752178 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.752981 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.753427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.767077 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: DELETE /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 HTTP/1.1 Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:08.768711 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.770358 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '78cc4e77-f019-4285-ac19-c01b7c96a515'} Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:08.771168 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.773172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.774599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:08.774599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-378d19ec-7b08-4d60-94b7-5a45fb686cb9 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "DELETE /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 404 len: 111 microversion: 2.1 time: 0.029834 Aug 01 14:21:08.774599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 656/1296] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:08 2022] DELETE /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:08.779089 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:08.780244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] [instance: 78cc4e77-f019-4285-ac19-c01b7c96a515] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:08.786654 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.787106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.787873 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:08.788352 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:08.802351 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] HTTP exception thrown: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Request method failure captured: Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 HTTP/1.1 Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi595_BeNY_bD9GTu1ICrV3pd2o4yJWm3J_h2YFhIKWXiwHQNaCQh7pKr_-TOMkkXZFEhoCztvIcG95UrN_F2lSB1MTFoFFa1A2AM66yAZM-qmY3VqeV5GU9Hawixq8t7jJ4mlVEJchVc8FXrZY_N07JqJu1CrbI9hovpCXs7qF4HmFMY Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:21:08.803904 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a3203f080a05422e83090a1f0a31d1a9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a3203f080a05422e83090a1f0a31d1a9"}]}] Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a3203f080a05422e83090a1f0a31d1a9 Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2133085870 Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: ca3cd1c2aec94b43aff0034b812a069d Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-2133085870-project Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.805535 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '78cc4e77-f019-4285-ac19-c01b7c96a515'} Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:08.806329 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. Aug 01 14:21:08.807779 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:21:08.809156 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] Returning 404 to user: Instance 78cc4e77-f019-4285-ac19-c01b7c96a515 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:08.809156 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6c8f18c3-4585-481f-b202-55d44ccdb1e3 tempest-AttachVolumeNegativeTest-2133085870 tempest-AttachVolumeNegativeTest-2133085870-project] 10.222.0.48 "GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515" status: 404 len: 111 microversion: 2.1 time: 0.030068 Aug 01 14:21:08.810447 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 641/1297] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:08 2022] GET /compute/v2.1/servers/78cc4e77-f019-4285-ac19-c01b7c96a515 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:22.427867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f164843f-ce4b-458d-a0a5-98f48c218377 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:22.428366 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f164843f-ce4b-458d-a0a5-98f48c218377 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:22.434498 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:22.435143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-4250c06c-692e-48a8-85b5-775c95cb3937 req-612b5264-71bb-45e9-ac7d-02dbba3d7fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be944f58-3d1b-43af-bd53-5d0f0c17f6a7", "tag": "6557d142-b394-4c3c-b200-64bd14908f59"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:22.435667 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:22.437693 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f164843f-ce4b-458d-a0a5-98f48c218377 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.438521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f164843f-ce4b-458d-a0a5-98f48c218377 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.439615 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f164843f-ce4b-458d-a0a5-98f48c218377 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.440420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f164843f-ce4b-458d-a0a5-98f48c218377 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.446661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=11 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:22.447591 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:22.450389 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4250c06c-692e-48a8-85b5-775c95cb3937 req-612b5264-71bb-45e9-ac7d-02dbba3d7fb7 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.451527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4250c06c-692e-48a8-85b5-775c95cb3937 req-612b5264-71bb-45e9-ac7d-02dbba3d7fb7 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.476840 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-4250c06c-692e-48a8-85b5-775c95cb3937 req-612b5264-71bb-45e9-ac7d-02dbba3d7fb7 service nova] Creating event network-changed:6557d142-b394-4c3c-b200-64bd14908f59 for instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 on hv-cinder-84713 Aug 01 14:21:22.485489 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-4250c06c-692e-48a8-85b5-775c95cb3937 req-612b5264-71bb-45e9-ac7d-02dbba3d7fb7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053923 Aug 01 14:21:22.486743 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 642/1298] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:22.488769 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f164843f-ce4b-458d-a0a5-98f48c218377 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:21:22.588544 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f164843f-ce4b-458d-a0a5-98f48c218377 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "DELETE /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 204 len: 0 microversion: 2.1 time: 0.164246 Aug 01 14:21:22.589211 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 657/1299] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:22 2022] DELETE /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:21:22.598139 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-89fa057e-ce43-4eea-9cc5-3a7c093d73f7 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:22.599071 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-89fa057e-ce43-4eea-9cc5-3a7c093d73f7 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:22.606106 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89fa057e-ce43-4eea-9cc5-3a7c093d73f7 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.606754 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89fa057e-ce43-4eea-9cc5-3a7c093d73f7 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.607714 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89fa057e-ce43-4eea-9cc5-3a7c093d73f7 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:22.608306 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89fa057e-ce43-4eea-9cc5-3a7c093d73f7 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:22.758698 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-89fa057e-ce43-4eea-9cc5-3a7c093d73f7 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:22.767916 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-89fa057e-ce43-4eea-9cc5-3a7c093d73f7 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.174089 Aug 01 14:21:22.769417 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 643/1300] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:22 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:23.796807 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1a8ba3f4-f1f4-46e9-8142-765c39289ca1 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:23.796807 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1a8ba3f4-f1f4-46e9-8142-765c39289ca1 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:23.799690 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1a8ba3f4-f1f4-46e9-8142-765c39289ca1 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:23.800250 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1a8ba3f4-f1f4-46e9-8142-765c39289ca1 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:23.801057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1a8ba3f4-f1f4-46e9-8142-765c39289ca1 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:23.801499 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1a8ba3f4-f1f4-46e9-8142-765c39289ca1 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:23.943182 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1a8ba3f4-f1f4-46e9-8142-765c39289ca1 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:23.951192 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1a8ba3f4-f1f4-46e9-8142-765c39289ca1 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.164360 Aug 01 14:21:23.951760 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 658/1301] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:23 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:24.973991 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aaee4ba3-371b-4318-bed2-7c02d65b19bb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:24.975086 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aaee4ba3-371b-4318-bed2-7c02d65b19bb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:24.982229 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aaee4ba3-371b-4318-bed2-7c02d65b19bb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.983055 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aaee4ba3-371b-4318-bed2-7c02d65b19bb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:24.983814 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aaee4ba3-371b-4318-bed2-7c02d65b19bb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:24.984244 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aaee4ba3-371b-4318-bed2-7c02d65b19bb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:25.120135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aaee4ba3-371b-4318-bed2-7c02d65b19bb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:25.127769 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aaee4ba3-371b-4318-bed2-7c02d65b19bb tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.158051 Aug 01 14:21:25.128346 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 644/1302] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:24 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:26.149246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-36922a28-ff1b-4aa6-bc15-1ced1663356f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:26.149911 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-36922a28-ff1b-4aa6-bc15-1ced1663356f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:26.161545 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-36922a28-ff1b-4aa6-bc15-1ced1663356f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.162223 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-36922a28-ff1b-4aa6-bc15-1ced1663356f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.163134 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-36922a28-ff1b-4aa6-bc15-1ced1663356f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:26.163580 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-36922a28-ff1b-4aa6-bc15-1ced1663356f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:26.305467 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-36922a28-ff1b-4aa6-bc15-1ced1663356f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:26.313907 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-36922a28-ff1b-4aa6-bc15-1ced1663356f tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.168391 Aug 01 14:21:26.314510 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 659/1303] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:26 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:27.336267 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a0c08131-8be6-4400-9bde-1e5f5431db27 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:27.336915 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a0c08131-8be6-4400-9bde-1e5f5431db27 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:27.343338 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0c08131-8be6-4400-9bde-1e5f5431db27 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.343972 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0c08131-8be6-4400-9bde-1e5f5431db27 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.344778 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0c08131-8be6-4400-9bde-1e5f5431db27 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:27.345219 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0c08131-8be6-4400-9bde-1e5f5431db27 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:27.532498 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a0c08131-8be6-4400-9bde-1e5f5431db27 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:27.540275 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a0c08131-8be6-4400-9bde-1e5f5431db27 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1568 microversion: 2.1 time: 0.207791 Aug 01 14:21:27.540925 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 645/1304] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:27 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:28.291574 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-a1d9071f-b405-4b02-943d-ec2f3681d69f req-797d9e34-755d-4fb9-864a-f990800429a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be944f58-3d1b-43af-bd53-5d0f0c17f6a7", "name": "network-vif-deleted", "tag": "6557d142-b394-4c3c-b200-64bd14908f59"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:28.313088 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-a1d9071f-b405-4b02-943d-ec2f3681d69f req-797d9e34-755d-4fb9-864a-f990800429a2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.313894 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-a1d9071f-b405-4b02-943d-ec2f3681d69f req-797d9e34-755d-4fb9-864a-f990800429a2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.327142 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-a1d9071f-b405-4b02-943d-ec2f3681d69f req-797d9e34-755d-4fb9-864a-f990800429a2 service nova] Creating event network-vif-deleted:6557d142-b394-4c3c-b200-64bd14908f59 for instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 on hv-cinder-84713 Aug 01 14:21:28.333015 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-a1d9071f-b405-4b02-943d-ec2f3681d69f req-797d9e34-755d-4fb9-864a-f990800429a2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047357 Aug 01 14:21:28.334687 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 660/1305] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:28.562441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5767c2c4-20c2-4c08-b53d-ed7ce786f969 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:28.563062 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5767c2c4-20c2-4c08-b53d-ed7ce786f969 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:28.571553 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5767c2c4-20c2-4c08-b53d-ed7ce786f969 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.572011 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5767c2c4-20c2-4c08-b53d-ed7ce786f969 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.572985 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5767c2c4-20c2-4c08-b53d-ed7ce786f969 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:28.573251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5767c2c4-20c2-4c08-b53d-ed7ce786f969 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:28.669711 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5767c2c4-20c2-4c08-b53d-ed7ce786f969 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86cef19aed2a45fb87c30dbd2d422dae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11b6361110344b0a67b6b73ccc0c2f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:28.693975 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5767c2c4-20c2-4c08-b53d-ed7ce786f969 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 200 len: 1219 microversion: 2.1 time: 0.130590 Aug 01 14:21:28.711544 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 646/1306] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:28 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 1219 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:29.718879 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:29.719765 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] [instance: be944f58-3d1b-43af-bd53-5d0f0c17f6a7] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:29.726921 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.727374 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.728318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:29.728785 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:29.745215 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] HTTP exception thrown: Instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 could not be found. Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Request method failure captured: Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 HTTP/1.1 Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi59_xggmh5fA_j2Hk00T9Qr5jgMtVvN69QmL-ocJrYAVxOFEdMb-n8LIiJps-dwP-GVO9dxxtEFrr8BHnrYfyYnVTw06YLcppE82oRW3-xrKTYDvqO3G7nuI0TSd-fVqSi3KtpjbZ1YHJ2zMUMf1J-QPymbmhhYWQzPlPPGRbNPtA4A0 Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: d11b6361110344b0a67b6b73ccc0c2f4 Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-TestShelveInstance-1761021506 Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:21:29.746820 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d11b6361110344b0a67b6b73ccc0c2f4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11b6361110344b0a67b6b73ccc0c2f4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d11b6361110344b0a67b6b73ccc0c2f4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11b6361110344b0a67b6b73ccc0c2f4"}]}] Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-TestShelveInstance-1761021506 Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: d11b6361110344b0a67b6b73ccc0c2f4 Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-TestShelveInstance-1761021506 Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-TestShelveInstance-1761021506-project Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 86cef19aed2a45fb87c30dbd2d422dae Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-TestShelveInstance-1761021506-project Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 could not be found. Aug 01 14:21:29.748446 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': 'be944f58-3d1b-43af-bd53-5d0f0c17f6a7'} Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 could not be found. Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:21:29.749521 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 could not be found. Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 could not be found. Aug 01 14:21:29.751184 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:21:29.753552 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Returning 404 to user: Instance be944f58-3d1b-43af-bd53-5d0f0c17f6a7 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:21:29.754457 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-8d422e13-9450-4449-b855-e76b3a16de31 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7" status: 404 len: 111 microversion: 2.1 time: 0.040207 Aug 01 14:21:29.758310 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 661/1307] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:29 2022] GET /compute/v2.1/servers/be944f58-3d1b-43af-bd53-5d0f0c17f6a7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:21:29.960539 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9a1e9fbf-4e36-4420-b215-686f51fba596 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] Calling method '.version_select at 0x7f4462c725e0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:30.004042 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9a1e9fbf-4e36-4420-b215-686f51fba596 tempest-TestShelveInstance-1761021506 tempest-TestShelveInstance-1761021506-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-922602789" status: 202 len: 0 microversion: 2.1 time: 0.048310 Aug 01 14:21:30.005007 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 647/1308] 10.222.0.48 () {58 vars in 1251 bytes} [Mon Aug 1 14:21:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-922602789 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:21:55.564633 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-76e8aa9f-deef-42ae-96df-3c96df3d2b27 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:55.565126 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-76e8aa9f-deef-42ae-96df-3c96df3d2b27 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:55.567826 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-4e5a6374-11fb-444e-8bf6-159f04cbb654 req-fd5a709f-929e-431e-83c1-ca22b51699b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba8dc70d-8222-40b1-a2cf-a38869ab56a8", "tag": "3cf51f68-6ca3-4a80-89a9-544c48237810"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:55.568246 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:55.568793 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:55.574278 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=26 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:55.575538 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:21:55.576036 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76e8aa9f-deef-42ae-96df-3c96df3d2b27 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.576498 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76e8aa9f-deef-42ae-96df-3c96df3d2b27 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.577281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76e8aa9f-deef-42ae-96df-3c96df3d2b27 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.577769 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-76e8aa9f-deef-42ae-96df-3c96df3d2b27 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.585083 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4e5a6374-11fb-444e-8bf6-159f04cbb654 req-fd5a709f-929e-431e-83c1-ca22b51699b9 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.585669 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4e5a6374-11fb-444e-8bf6-159f04cbb654 req-fd5a709f-929e-431e-83c1-ca22b51699b9 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.599109 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-4e5a6374-11fb-444e-8bf6-159f04cbb654 req-fd5a709f-929e-431e-83c1-ca22b51699b9 service nova] Creating event network-changed:3cf51f68-6ca3-4a80-89a9-544c48237810 for instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 on hv-cinder-84713 Aug 01 14:21:55.606004 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-4e5a6374-11fb-444e-8bf6-159f04cbb654 req-fd5a709f-929e-431e-83c1-ca22b51699b9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043280 Aug 01 14:21:55.606946 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 648/1309] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:21:55.609700 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-76e8aa9f-deef-42ae-96df-3c96df3d2b27 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:21:55.698209 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-76e8aa9f-deef-42ae-96df-3c96df3d2b27 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 204 len: 0 microversion: 2.1 time: 0.137743 Aug 01 14:21:55.699546 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 662/1310] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:21:55 2022] DELETE /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:21:55.710052 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1167170e-b988-4d19-97fa-7c0a541f4204 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:55.710840 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1167170e-b988-4d19-97fa-7c0a541f4204 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:55.720050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1167170e-b988-4d19-97fa-7c0a541f4204 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.720680 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1167170e-b988-4d19-97fa-7c0a541f4204 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.721473 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1167170e-b988-4d19-97fa-7c0a541f4204 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:55.722452 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1167170e-b988-4d19-97fa-7c0a541f4204 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:55.881512 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1167170e-b988-4d19-97fa-7c0a541f4204 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:55.889318 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1167170e-b988-4d19-97fa-7c0a541f4204 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1576 microversion: 2.1 time: 0.185297 Aug 01 14:21:55.889890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 649/1311] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:55 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:56.911806 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-9c76d5a0-75b4-4301-89c1-b3d4e4b5ca50 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:56.912616 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-9c76d5a0-75b4-4301-89c1-b3d4e4b5ca50 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:56.920138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9c76d5a0-75b4-4301-89c1-b3d4e4b5ca50 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.920721 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9c76d5a0-75b4-4301-89c1-b3d4e4b5ca50 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:56.921634 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9c76d5a0-75b4-4301-89c1-b3d4e4b5ca50 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:56.922110 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-9c76d5a0-75b4-4301-89c1-b3d4e4b5ca50 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:57.106764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-9c76d5a0-75b4-4301-89c1-b3d4e4b5ca50 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:57.115802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-9c76d5a0-75b4-4301-89c1-b3d4e4b5ca50 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1576 microversion: 2.1 time: 0.208841 Aug 01 14:21:57.116995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 663/1312] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:56 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:58.138964 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8e1987c8-c20a-47e7-8ff2-573523b2046c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:58.139580 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8e1987c8-c20a-47e7-8ff2-573523b2046c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:58.146368 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8e1987c8-c20a-47e7-8ff2-573523b2046c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:58.146829 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8e1987c8-c20a-47e7-8ff2-573523b2046c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:58.147674 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8e1987c8-c20a-47e7-8ff2-573523b2046c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:58.148112 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8e1987c8-c20a-47e7-8ff2-573523b2046c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:58.360152 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8e1987c8-c20a-47e7-8ff2-573523b2046c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:58.367001 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8e1987c8-c20a-47e7-8ff2-573523b2046c tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1458 microversion: 2.1 time: 0.231885 Aug 01 14:21:58.367587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 650/1313] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:58 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1458 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:21:58.418137 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-c15f6b6c-f7de-423d-aaff-8de115b27d06 req-691e5e85-a0ab-41a9-a68a-9f45b9b0381c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba8dc70d-8222-40b1-a2cf-a38869ab56a8", "name": "network-vif-deleted", "tag": "3cf51f68-6ca3-4a80-89a9-544c48237810"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:21:58.426773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-c15f6b6c-f7de-423d-aaff-8de115b27d06 req-691e5e85-a0ab-41a9-a68a-9f45b9b0381c service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:58.427224 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-c15f6b6c-f7de-423d-aaff-8de115b27d06 req-691e5e85-a0ab-41a9-a68a-9f45b9b0381c service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:58.439401 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-c15f6b6c-f7de-423d-aaff-8de115b27d06 req-691e5e85-a0ab-41a9-a68a-9f45b9b0381c service nova] Creating event network-vif-deleted:3cf51f68-6ca3-4a80-89a9-544c48237810 for instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 on hv-cinder-84713 Aug 01 14:21:58.444002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-c15f6b6c-f7de-423d-aaff-8de115b27d06 req-691e5e85-a0ab-41a9-a68a-9f45b9b0381c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032331 Aug 01 14:21:58.447638 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 664/1314] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:21:59.387945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6cae653f-84b7-48ad-808c-7cb1b392fd32 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:21:59.388511 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6cae653f-84b7-48ad-808c-7cb1b392fd32 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:21:59.395582 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cae653f-84b7-48ad-808c-7cb1b392fd32 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.396022 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cae653f-84b7-48ad-808c-7cb1b392fd32 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.396801 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cae653f-84b7-48ad-808c-7cb1b392fd32 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:21:59.397230 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cae653f-84b7-48ad-808c-7cb1b392fd32 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:21:59.457881 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6cae653f-84b7-48ad-808c-7cb1b392fd32 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:21:59.465309 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6cae653f-84b7-48ad-808c-7cb1b392fd32 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1225 microversion: 2.1 time: 0.081298 Aug 01 14:21:59.465869 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 651/1315] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:21:59 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:00.487621 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-1725fedd-1051-46ba-8fd5-510fe1e47dd4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:00.488351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-1725fedd-1051-46ba-8fd5-510fe1e47dd4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:00.494595 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1725fedd-1051-46ba-8fd5-510fe1e47dd4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.495052 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1725fedd-1051-46ba-8fd5-510fe1e47dd4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.495822 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1725fedd-1051-46ba-8fd5-510fe1e47dd4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:00.496267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-1725fedd-1051-46ba-8fd5-510fe1e47dd4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:00.560761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-1725fedd-1051-46ba-8fd5-510fe1e47dd4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:00.568201 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-1725fedd-1051-46ba-8fd5-510fe1e47dd4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1225 microversion: 2.1 time: 0.085882 Aug 01 14:22:00.568802 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 665/1316] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:00 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:01.590034 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b87fd9b4-e16e-49cd-bcf5-bfedb22bcb03 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:01.590551 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b87fd9b4-e16e-49cd-bcf5-bfedb22bcb03 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:01.597619 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b87fd9b4-e16e-49cd-bcf5-bfedb22bcb03 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:01.598069 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b87fd9b4-e16e-49cd-bcf5-bfedb22bcb03 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:01.598863 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b87fd9b4-e16e-49cd-bcf5-bfedb22bcb03 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:01.599302 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b87fd9b4-e16e-49cd-bcf5-bfedb22bcb03 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:01.668263 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b87fd9b4-e16e-49cd-bcf5-bfedb22bcb03 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:01.676611 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b87fd9b4-e16e-49cd-bcf5-bfedb22bcb03 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1225 microversion: 2.1 time: 0.090765 Aug 01 14:22:01.677189 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 652/1317] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:01 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:02.697386 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c45850d3-2ed4-47c4-b8da-71ddd681ed81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:02.698002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c45850d3-2ed4-47c4-b8da-71ddd681ed81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:02.704534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c45850d3-2ed4-47c4-b8da-71ddd681ed81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.704986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c45850d3-2ed4-47c4-b8da-71ddd681ed81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.706344 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c45850d3-2ed4-47c4-b8da-71ddd681ed81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:02.706953 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c45850d3-2ed4-47c4-b8da-71ddd681ed81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:02.770268 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c45850d3-2ed4-47c4-b8da-71ddd681ed81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:02.777780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c45850d3-2ed4-47c4-b8da-71ddd681ed81 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1225 microversion: 2.1 time: 0.084266 Aug 01 14:22:02.778343 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 666/1318] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:02 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:03.798936 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:03.799556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:03.806630 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:03.807344 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:03.808163 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:03.808634 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:03.844622 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:03.845075 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:03.845524 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lazy-loading 'fault' on Instance uuid ba8dc70d-8222-40b1-a2cf-a38869ab56a8 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:03.887965 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:03.897147 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ac19a720-6aed-4f5d-ad1e-a6103c781f14 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 200 len: 1230 microversion: 2.1 time: 0.102058 Aug 01 14:22:03.897907 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 653/1319] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:03 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:04.918339 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:04.919163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ba8dc70d-8222-40b1-a2cf-a38869ab56a8] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:04.926653 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.927102 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.927863 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:04.928299 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:04.942070 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] HTTP exception thrown: Instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 could not be found. Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Request method failure captured: Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 HTTP/1.1 Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi598U0vpbEZe_lzpVi-XbfwElx8PoIWStBmS6FsDic3i5z8sNsAqEXlHh41-hxbJingtd0ApxVmYr4l2FSMqaq-miBtb0IBbuqlF1boy0McMo_8DyjaSBaH1OrESPws99W0Mkgzg3iqaB4rsCoCek6V_KSk9QMQ31OgpZWS8R95UcttE Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:22:04.943726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7bb93e302f1441fca85409de83230d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}] Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 2eb09df64dd74ddeb9fbbf44ae0a3592 Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 could not be found. Aug 01 14:22:04.945484 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': 'ba8dc70d-8222-40b1-a2cf-a38869ab56a8'} Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 could not be found. Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:04.946534 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 could not be found. Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 could not be found. Aug 01 14:22:04.947858 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:04.949158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Returning 404 to user: Instance ba8dc70d-8222-40b1-a2cf-a38869ab56a8 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:04.949158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-671b068f-f77f-4ba3-9623-f587408d9aa3 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8" status: 404 len: 111 microversion: 2.1 time: 0.031362 Aug 01 14:22:04.949158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 667/1320] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:04 2022] GET /compute/v2.1/servers/ba8dc70d-8222-40b1-a2cf-a38869ab56a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:08.124079 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dd6d5341-fe85-4c6a-83e5-d77fdbb89fc2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:08.124631 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dd6d5341-fe85-4c6a-83e5-d77fdbb89fc2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:08.134751 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd6d5341-fe85-4c6a-83e5-d77fdbb89fc2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.137173 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd6d5341-fe85-4c6a-83e5-d77fdbb89fc2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.138270 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd6d5341-fe85-4c6a-83e5-d77fdbb89fc2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.138838 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dd6d5341-fe85-4c6a-83e5-d77fdbb89fc2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.168079 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dd6d5341-fe85-4c6a-83e5-d77fdbb89fc2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:22:08.325609 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dd6d5341-fe85-4c6a-83e5-d77fdbb89fc2 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "DELETE /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 204 len: 0 microversion: 2.1 time: 0.204548 Aug 01 14:22:08.326251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 654/1321] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:22:08 2022] DELETE /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:22:08.349299 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d1ab37f0-2dff-461e-ae35-8eec02857cb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:08.351046 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d1ab37f0-2dff-461e-ae35-8eec02857cb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:08.369556 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1ab37f0-2dff-461e-ae35-8eec02857cb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.370018 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1ab37f0-2dff-461e-ae35-8eec02857cb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.370813 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1ab37f0-2dff-461e-ae35-8eec02857cb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.371252 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d1ab37f0-2dff-461e-ae35-8eec02857cb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.483970 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-b8aff15b-0783-4a86-99cc-9f3cb57d9746 req-4dba11b9-d930-409f-a7a5-4fe58846eaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77efc1e4-f466-4454-8f66-234276687e49", "tag": "ac84e85d-c243-4cb3-8ab7-11ae2fb7285b"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:08.497010 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-b8aff15b-0783-4a86-99cc-9f3cb57d9746 req-4dba11b9-d930-409f-a7a5-4fe58846eaf9 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:08.498199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-b8aff15b-0783-4a86-99cc-9f3cb57d9746 req-4dba11b9-d930-409f-a7a5-4fe58846eaf9 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:08.527660 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-b8aff15b-0783-4a86-99cc-9f3cb57d9746 req-4dba11b9-d930-409f-a7a5-4fe58846eaf9 service nova] Creating event network-changed:ac84e85d-c243-4cb3-8ab7-11ae2fb7285b for instance 77efc1e4-f466-4454-8f66-234276687e49 on hv-cinder-84713 Aug 01 14:22:08.537113 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-b8aff15b-0783-4a86-99cc-9f3cb57d9746 req-4dba11b9-d930-409f-a7a5-4fe58846eaf9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.405093 Aug 01 14:22:08.543925 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 668/1322] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:08.689344 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d1ab37f0-2dff-461e-ae35-8eec02857cb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:08.725277 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d1ab37f0-2dff-461e-ae35-8eec02857cb4 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1576 microversion: 2.1 time: 0.390466 Aug 01 14:22:08.727262 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 655/1323] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:08 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1576 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:09.758135 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ed6c123a-158e-415a-b013-a9738c033a7b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:09.759558 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ed6c123a-158e-415a-b013-a9738c033a7b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:09.769599 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ed6c123a-158e-415a-b013-a9738c033a7b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.770218 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ed6c123a-158e-415a-b013-a9738c033a7b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.771346 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ed6c123a-158e-415a-b013-a9738c033a7b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:09.773092 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ed6c123a-158e-415a-b013-a9738c033a7b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:09.957952 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ed6c123a-158e-415a-b013-a9738c033a7b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eb09df64dd74ddeb9fbbf44ae0a3592', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bb93e302f1441fca85409de83230d6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:09.966699 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ed6c123a-158e-415a-b013-a9738c033a7b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 200 len: 1458 microversion: 2.1 time: 0.212784 Aug 01 14:22:09.967348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 669/1324] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:09 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 1458 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:10.076651 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-271792c0-bbec-4f63-a0ed-348f7bf006a6 req-c109576a-7176-4f91-9666-3979e7c9bd37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77efc1e4-f466-4454-8f66-234276687e49", "name": "network-vif-deleted", "tag": "ac84e85d-c243-4cb3-8ab7-11ae2fb7285b"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:10.092649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-271792c0-bbec-4f63-a0ed-348f7bf006a6 req-c109576a-7176-4f91-9666-3979e7c9bd37 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.092649 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-271792c0-bbec-4f63-a0ed-348f7bf006a6 req-c109576a-7176-4f91-9666-3979e7c9bd37 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:10.101297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-271792c0-bbec-4f63-a0ed-348f7bf006a6 req-c109576a-7176-4f91-9666-3979e7c9bd37 service nova] Creating event network-vif-deleted:ac84e85d-c243-4cb3-8ab7-11ae2fb7285b for instance 77efc1e4-f466-4454-8f66-234276687e49 on hv-cinder-84713 Aug 01 14:22:10.107027 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-271792c0-bbec-4f63-a0ed-348f7bf006a6 req-c109576a-7176-4f91-9666-3979e7c9bd37 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034734 Aug 01 14:22:10.108120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 656/1325] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:10.990097 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:10.990700 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: 77efc1e4-f466-4454-8f66-234276687e49] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:10.997469 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.997913 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:10.999279 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:10.999720 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.013164 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] HTTP exception thrown: Instance 77efc1e4-f466-4454-8f66-234276687e49 could not be found. Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Request method failure captured: Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 HTTP/1.1 Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi598U0vpbEZe_lzpVi-XbfwElx8PoIWStBmS6FsDic3i5z8sNsAqEXlHh41-hxbJingtd0ApxVmYr4l2FSMqaq-miBtb0IBbuqlF1boy0McMo_8DyjaSBaH1OrESPws99W0Mkgzg3iqaB4rsCoCek6V_KSk9QMQ31OgpZWS8R95UcttE Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:22:11.014876 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7bb93e302f1441fca85409de83230d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}] Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 2eb09df64dd74ddeb9fbbf44ae0a3592 Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance 77efc1e4-f466-4454-8f66-234276687e49 could not be found. Aug 01 14:22:11.016702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': '77efc1e4-f466-4454-8f66-234276687e49'} Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77efc1e4-f466-4454-8f66-234276687e49 could not be found. Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:11.018675 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77efc1e4-f466-4454-8f66-234276687e49 could not be found. Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77efc1e4-f466-4454-8f66-234276687e49 could not be found. Aug 01 14:22:11.020430 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.022428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Returning 404 to user: Instance 77efc1e4-f466-4454-8f66-234276687e49 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:11.022428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-88a3c8f2-24f9-4e9b-9217-00f622dcc689 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49" status: 404 len: 111 microversion: 2.1 time: 0.030736 Aug 01 14:22:11.022428 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 670/1326] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:10 2022] GET /compute/v2.1/servers/77efc1e4-f466-4454-8f66-234276687e49 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:11.470423 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:11.470919 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:11.478581 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.479188 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.480095 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.480751 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.496718 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] HTTP exception thrown: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Request method failure captured: Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 HTTP/1.1 Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi598U0vpbEZe_lzpVi-XbfwElx8PoIWStBmS6FsDic3i5z8sNsAqEXlHh41-hxbJingtd0ApxVmYr4l2FSMqaq-miBtb0IBbuqlF1boy0McMo_8DyjaSBaH1OrESPws99W0Mkgzg3iqaB4rsCoCek6V_KSk9QMQ31OgpZWS8R95UcttE Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:22:11.498390 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7bb93e302f1441fca85409de83230d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}] Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: 2eb09df64dd74ddeb9fbbf44ae0a3592 Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.500047 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'ec0c5482-0e86-4a38-8b7e-69b2e4def9e5'} Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:11.500898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.502815 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.504192 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Returning 404 to user: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:11.504192 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-87907b0d-b83c-4321-8c94-d03722c5547a tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 404 len: 111 microversion: 2.1 time: 0.034332 Aug 01 14:22:11.504192 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 657/1327] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:22:11 2022] DELETE /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:11.509196 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:11.509818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] [instance: ec0c5482-0e86-4a38-8b7e-69b2e4def9e5] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:11.516101 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.516585 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.517431 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:11.517871 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:11.532208 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.wsgi [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] HTTP exception thrown: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Request method failure captured: Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: request: GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 HTTP/1.1 Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept: application/json Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Accept-Encoding: identity Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Connection: close Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Length: 0 Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Content-Type: application/json Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Host: 10.222.0.48 Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Openstack-System-Scope: None Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Auth-Token: gAAAAABi598U0vpbEZe_lzpVi-XbfwElx8PoIWStBmS6FsDic3i5z8sNsAqEXlHh41-hxbJingtd0ApxVmYr4l2FSMqaq-miBtb0IBbuqlF1boy0McMo_8DyjaSBaH1OrESPws99W0Mkgzg3iqaB4rsCoCek6V_KSk9QMQ31OgpZWS8R95UcttE Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Id: None Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Domain-Name: None Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Identity-Status: Confirmed Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Is-Admin-Project: True Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Id: default Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Domain-Name: Default Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Project-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Role: reader,member Aug 01 14:22:11.534420 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Roles: reader,member Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_7bb93e302f1441fca85409de83230d6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/7bb93e302f1441fca85409de83230d6a"}]}] Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Id: 7bb93e302f1441fca85409de83230d6a Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-Tenant-Name: tempest-TestVolumeBootPattern-1192387341 Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Id: default Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Domain-Name: Default Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Id: 2eb09df64dd74ddeb9fbbf44ae0a3592 Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: X-User-Name: tempest-TestVolumeBootPattern-1192387341-project Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: method: > Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: exception: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.536130 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: action_args: {'id': 'ec0c5482-0e86-4a38-8b7e-69b2e4def9e5'} Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:11.537068 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. Aug 01 14:22:11.538531 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: ERROR nova.api.openstack.wsgi Aug 01 14:22:11.540294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Returning 404 to user: Instance ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 could not be found. {{(pid=117857) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:11.540294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ecc093c4-ce8b-48be-9a5c-60ca6a820298 tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5" status: 404 len: 111 microversion: 2.1 time: 0.030592 Aug 01 14:22:11.540294 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 671/1328] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:11 2022] GET /compute/v2.1/servers/ec0c5482-0e86-4a38-8b7e-69b2e4def9e5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:12.857332 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b37a2428-1acd-4fbd-a89c-a0dbd2be6f1b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] Calling method '.version_select at 0x7f4462c32310>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:12.880352 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b37a2428-1acd-4fbd-a89c-a0dbd2be6f1b tempest-TestVolumeBootPattern-1192387341 tempest-TestVolumeBootPattern-1192387341-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-162466780" status: 202 len: 0 microversion: 2.1 time: 0.026770 Aug 01 14:22:12.881657 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 658/1329] 10.222.0.48 () {58 vars in 1260 bytes} [Mon Aug 1 14:22:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-162466780 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 01 14:22:25.366448 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:22:25.367035 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Mon Aug 1 14:22:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:22:28.443764 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1084950997", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "networks": [{"uuid": "4558c6e3-7c37-4e92-be98-f6bf06481653"}]}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:28.452796 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:28.453557 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:28.522629 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] validate_networks() for [('4558c6e3-7c37-4e92-be98-f6bf06481653', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:22:28.936654 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:22:28.937086 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:22:28.937566 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:22:28.937980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:22:28.938397 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:22:28.947175 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.947626 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.948427 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:28.948897 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:28.965233 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Getting quotas for project 57de109e747f4f80a6c572f194367f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:22:28.969635 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Getting quotas for user fedc3dfad8284827855defaedda75283 and project 57de109e747f4f80a6c572f194367f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:22:28.980731 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:22:28.982943 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:22:29.029645 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a72835d6-8339-4736-a7b2-568c69a0adb9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.589889 Aug 01 14:22:29.030313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 672/1330] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:22:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:22:29.041666 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-59e93afb-2964-4a2a-bc6a-7012f998f330 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:29.042281 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-59e93afb-2964-4a2a-bc6a-7012f998f330 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:29.045562 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:29.046204 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:29.104639 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59e93afb-2964-4a2a-bc6a-7012f998f330 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:29.111512 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-59e93afb-2964-4a2a-bc6a-7012f998f330 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1214 microversion: 2.1 time: 0.073683 Aug 01 14:22:29.112270 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 659/1331] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:29 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:30.132278 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-2b0c4675-c8f9-4fa8-9c21-5e60c3cdb947 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:30.132927 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-2b0c4675-c8f9-4fa8-9c21-5e60c3cdb947 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:30.141414 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2b0c4675-c8f9-4fa8-9c21-5e60c3cdb947 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:30.141867 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2b0c4675-c8f9-4fa8-9c21-5e60c3cdb947 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:30.142695 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2b0c4675-c8f9-4fa8-9c21-5e60c3cdb947 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:30.143138 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-2b0c4675-c8f9-4fa8-9c21-5e60c3cdb947 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:30.212788 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-2b0c4675-c8f9-4fa8-9c21-5e60c3cdb947 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:30.221091 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-2b0c4675-c8f9-4fa8-9c21-5e60c3cdb947 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1274 microversion: 2.1 time: 0.092708 Aug 01 14:22:30.221670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 673/1332] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:30 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:31.242890 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1bf331a9-1ae0-4374-8d60-ded8e154b6f3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:31.243540 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1bf331a9-1ae0-4374-8d60-ded8e154b6f3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:31.250673 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bf331a9-1ae0-4374-8d60-ded8e154b6f3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.251130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bf331a9-1ae0-4374-8d60-ded8e154b6f3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.251898 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bf331a9-1ae0-4374-8d60-ded8e154b6f3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.252331 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1bf331a9-1ae0-4374-8d60-ded8e154b6f3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.454984 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1bf331a9-1ae0-4374-8d60-ded8e154b6f3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:31.462546 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1bf331a9-1ae0-4374-8d60-ded8e154b6f3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1314 microversion: 2.1 time: 0.223585 Aug 01 14:22:31.463120 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 660/1333] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:31 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:31.535010 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-4ad8e85a-7e05-4584-b7f7-ceb9ca2278d5 req-403c94d7-443e-47e0-9b31-f71c2e053fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9318208-e8c5-4977-9ab8-bde2be23746c", "tag": "624bc350-e224-40ff-9108-5dffd5aa7cdd"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:31.546683 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-4ad8e85a-7e05-4584-b7f7-ceb9ca2278d5 req-403c94d7-443e-47e0-9b31-f71c2e053fc2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:31.547660 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-4ad8e85a-7e05-4584-b7f7-ceb9ca2278d5 req-403c94d7-443e-47e0-9b31-f71c2e053fc2 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:31.559348 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-4ad8e85a-7e05-4584-b7f7-ceb9ca2278d5 req-403c94d7-443e-47e0-9b31-f71c2e053fc2 service nova] Creating event network-changed:624bc350-e224-40ff-9108-5dffd5aa7cdd for instance c9318208-e8c5-4977-9ab8-bde2be23746c on hv-cinder-84713 Aug 01 14:22:31.564848 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-4ad8e85a-7e05-4584-b7f7-ceb9ca2278d5 req-403c94d7-443e-47e0-9b31-f71c2e053fc2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034321 Aug 01 14:22:31.565792 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 674/1334] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:32.484926 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c49c154-bf9b-479c-9a06-2dd012cd2733 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:32.485490 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6c49c154-bf9b-479c-9a06-2dd012cd2733 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:32.492342 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c49c154-bf9b-479c-9a06-2dd012cd2733 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.492824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c49c154-bf9b-479c-9a06-2dd012cd2733 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.493853 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c49c154-bf9b-479c-9a06-2dd012cd2733 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:32.494290 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c49c154-bf9b-479c-9a06-2dd012cd2733 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:32.628181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6c49c154-bf9b-479c-9a06-2dd012cd2733 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:32.635699 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6c49c154-bf9b-479c-9a06-2dd012cd2733 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1314 microversion: 2.1 time: 0.154880 Aug 01 14:22:32.636272 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 661/1335] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:32 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 01 14:22:33.658449 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f8ce187c-2054-480f-919c-6235ae2e91c1 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:33.659165 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f8ce187c-2054-480f-919c-6235ae2e91c1 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:33.665453 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f8ce187c-2054-480f-919c-6235ae2e91c1 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.665906 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f8ce187c-2054-480f-919c-6235ae2e91c1 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.666670 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f8ce187c-2054-480f-919c-6235ae2e91c1 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:33.667118 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f8ce187c-2054-480f-919c-6235ae2e91c1 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:33.826421 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-f8ce187c-2054-480f-919c-6235ae2e91c1 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:33.835608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f8ce187c-2054-480f-919c-6235ae2e91c1 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1314 microversion: 2.1 time: 0.182387 Aug 01 14:22:33.836206 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 675/1336] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:33 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:34.857288 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-561494ab-ec83-4936-8586-d2fdb61be9af tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:34.857900 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-561494ab-ec83-4936-8586-d2fdb61be9af tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:34.864956 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-561494ab-ec83-4936-8586-d2fdb61be9af tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.865428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-561494ab-ec83-4936-8586-d2fdb61be9af tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:34.866183 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-561494ab-ec83-4936-8586-d2fdb61be9af tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:34.866615 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-561494ab-ec83-4936-8586-d2fdb61be9af tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:35.001824 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-561494ab-ec83-4936-8586-d2fdb61be9af tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:35.009348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-561494ab-ec83-4936-8586-d2fdb61be9af tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1314 microversion: 2.1 time: 0.155884 Aug 01 14:22:35.009921 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 662/1337] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:34 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:36.031227 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-759d544d-f21c-44cc-9d73-13fafecacb7f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:36.032199 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-759d544d-f21c-44cc-9d73-13fafecacb7f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:36.038995 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-759d544d-f21c-44cc-9d73-13fafecacb7f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.039562 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-759d544d-f21c-44cc-9d73-13fafecacb7f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.040351 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-759d544d-f21c-44cc-9d73-13fafecacb7f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:36.040823 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-759d544d-f21c-44cc-9d73-13fafecacb7f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:36.184357 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-759d544d-f21c-44cc-9d73-13fafecacb7f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:36.193200 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-759d544d-f21c-44cc-9d73-13fafecacb7f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1314 microversion: 2.1 time: 0.167116 Aug 01 14:22:36.193766 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 676/1338] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:36 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:37.214226 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9d7db7dd-4a99-41c1-8fe1-b779da8db016 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:37.214876 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9d7db7dd-4a99-41c1-8fe1-b779da8db016 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:37.221804 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d7db7dd-4a99-41c1-8fe1-b779da8db016 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.222245 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d7db7dd-4a99-41c1-8fe1-b779da8db016 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.223003 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d7db7dd-4a99-41c1-8fe1-b779da8db016 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.223428 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d7db7dd-4a99-41c1-8fe1-b779da8db016 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.358135 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9d7db7dd-4a99-41c1-8fe1-b779da8db016 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:37.365588 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9d7db7dd-4a99-41c1-8fe1-b779da8db016 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1314 microversion: 2.1 time: 0.155308 Aug 01 14:22:37.366143 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 663/1339] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:37 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:37.833726 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-dff38c4f-cb9d-4e8f-a7fc-8d4e6bb5e3cc req-876ce692-ef09-4d05-babb-abe4d9c9cef8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9318208-e8c5-4977-9ab8-bde2be23746c", "name": "network-vif-plugged", "status": "completed", "tag": "624bc350-e224-40ff-9108-5dffd5aa7cdd"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:37.846364 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-dff38c4f-cb9d-4e8f-a7fc-8d4e6bb5e3cc req-876ce692-ef09-4d05-babb-abe4d9c9cef8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:37.846732 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-dff38c4f-cb9d-4e8f-a7fc-8d4e6bb5e3cc req-876ce692-ef09-4d05-babb-abe4d9c9cef8 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:37.857556 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-dff38c4f-cb9d-4e8f-a7fc-8d4e6bb5e3cc req-876ce692-ef09-4d05-babb-abe4d9c9cef8 service nova] Creating event network-vif-plugged:624bc350-e224-40ff-9108-5dffd5aa7cdd for instance c9318208-e8c5-4977-9ab8-bde2be23746c on hv-cinder-84713 Aug 01 14:22:37.863179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-dff38c4f-cb9d-4e8f-a7fc-8d4e6bb5e3cc req-876ce692-ef09-4d05-babb-abe4d9c9cef8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172733 Aug 01 14:22:37.863842 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 677/1340] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:22:38.386348 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a73b432b-f2e3-4332-9cd4-ea5199e76acf tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:38.386970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a73b432b-f2e3-4332-9cd4-ea5199e76acf tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:38.394473 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a73b432b-f2e3-4332-9cd4-ea5199e76acf tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.394930 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a73b432b-f2e3-4332-9cd4-ea5199e76acf tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.395705 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a73b432b-f2e3-4332-9cd4-ea5199e76acf tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:38.396140 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a73b432b-f2e3-4332-9cd4-ea5199e76acf tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:38.551137 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a73b432b-f2e3-4332-9cd4-ea5199e76acf tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:38.559397 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a73b432b-f2e3-4332-9cd4-ea5199e76acf tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1314 microversion: 2.1 time: 0.176957 Aug 01 14:22:38.559980 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 664/1341] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:38 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:39.578001 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:39.578758 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=6 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:39.583094 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-c13e4400-f240-4111-a77e-30943abb7c43 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:39.583803 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-c13e4400-f240-4111-a77e-30943abb7c43 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:39.590889 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c13e4400-f240-4111-a77e-30943abb7c43 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.591341 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c13e4400-f240-4111-a77e-30943abb7c43 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.592104 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c13e4400-f240-4111-a77e-30943abb7c43 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:39.592576 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-c13e4400-f240-4111-a77e-30943abb7c43 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:39.724002 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-c13e4400-f240-4111-a77e-30943abb7c43 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:39.732107 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-c13e4400-f240-4111-a77e-30943abb7c43 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1314 microversion: 2.1 time: 0.155518 Aug 01 14:22:39.733112 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 678/1342] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:39 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:40.754009 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dca50a0d-c941-441f-8bbd-5939423b8e6f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:40.754617 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dca50a0d-c941-441f-8bbd-5939423b8e6f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:40.756758 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:40.762301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dca50a0d-c941-441f-8bbd-5939423b8e6f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.762742 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dca50a0d-c941-441f-8bbd-5939423b8e6f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.763499 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dca50a0d-c941-441f-8bbd-5939423b8e6f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:40.763929 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dca50a0d-c941-441f-8bbd-5939423b8e6f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:40.905012 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dca50a0d-c941-441f-8bbd-5939423b8e6f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:40.913030 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dca50a0d-c941-441f-8bbd-5939423b8e6f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1497 microversion: 2.1 time: 0.162829 Aug 01 14:22:40.913600 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 665/1343] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:40 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:41.428539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-09aa6a48-eafe-4c2c-a0fc-e68124ed23c3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:41.429031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-09aa6a48-eafe-4c2c-a0fc-e68124ed23c3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:41.436165 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09aa6a48-eafe-4c2c-a0fc-e68124ed23c3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.437305 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09aa6a48-eafe-4c2c-a0fc-e68124ed23c3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.438092 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09aa6a48-eafe-4c2c-a0fc-e68124ed23c3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.438533 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-09aa6a48-eafe-4c2c-a0fc-e68124ed23c3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.464160 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-09aa6a48-eafe-4c2c-a0fc-e68124ed23c3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:22:41.539649 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-09aa6a48-eafe-4c2c-a0fc-e68124ed23c3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "DELETE /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 204 len: 0 microversion: 2.1 time: 0.114590 Aug 01 14:22:41.540313 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 679/1344] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:22:41 2022] DELETE /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:22:41.548855 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f27378ab-317a-4119-a399-9432a3f05bfb tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:41.549460 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f27378ab-317a-4119-a399-9432a3f05bfb tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:41.556098 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f27378ab-317a-4119-a399-9432a3f05bfb tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.556568 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f27378ab-317a-4119-a399-9432a3f05bfb tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.557330 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f27378ab-317a-4119-a399-9432a3f05bfb tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:41.557754 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f27378ab-317a-4119-a399-9432a3f05bfb tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:41.689820 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f27378ab-317a-4119-a399-9432a3f05bfb tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:41.697283 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f27378ab-317a-4119-a399-9432a3f05bfb tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1503 microversion: 2.1 time: 0.152542 Aug 01 14:22:41.697846 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 666/1345] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:41 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:42.719589 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-ecbedd2d-5e0b-4142-bfe7-2063e0235570 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:42.720281 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-ecbedd2d-5e0b-4142-bfe7-2063e0235570 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:42.726629 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ecbedd2d-5e0b-4142-bfe7-2063e0235570 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.727072 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ecbedd2d-5e0b-4142-bfe7-2063e0235570 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.727818 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ecbedd2d-5e0b-4142-bfe7-2063e0235570 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:42.728247 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-ecbedd2d-5e0b-4142-bfe7-2063e0235570 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:42.862372 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-ecbedd2d-5e0b-4142-bfe7-2063e0235570 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:42.870179 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-ecbedd2d-5e0b-4142-bfe7-2063e0235570 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1503 microversion: 2.1 time: 0.155377 Aug 01 14:22:42.870773 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 680/1346] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:42 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:43.597729 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-6375921f-1244-43a3-b03a-40b9d161bda7 req-dd0cd515-71da-4a85-bdcb-5db7bc4a236a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9318208-e8c5-4977-9ab8-bde2be23746c", "name": "network-vif-deleted", "tag": "624bc350-e224-40ff-9108-5dffd5aa7cdd"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:43.609859 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-6375921f-1244-43a3-b03a-40b9d161bda7 req-dd0cd515-71da-4a85-bdcb-5db7bc4a236a service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.610305 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-6375921f-1244-43a3-b03a-40b9d161bda7 req-dd0cd515-71da-4a85-bdcb-5db7bc4a236a service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.622912 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-6375921f-1244-43a3-b03a-40b9d161bda7 req-dd0cd515-71da-4a85-bdcb-5db7bc4a236a service nova] Creating event network-vif-deleted:624bc350-e224-40ff-9108-5dffd5aa7cdd for instance c9318208-e8c5-4977-9ab8-bde2be23746c on hv-cinder-84713 Aug 01 14:22:43.628998 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-6375921f-1244-43a3-b03a-40b9d161bda7 req-dd0cd515-71da-4a85-bdcb-5db7bc4a236a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034690 Aug 01 14:22:43.629608 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 667/1347] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:43.891919 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:43.892608 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:43.899212 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.899702 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.900470 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.900933 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.935485 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:43.935941 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:43.936942 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lazy-loading 'fault' on Instance uuid c9318208-e8c5-4977-9ab8-bde2be23746c {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:22:43.977951 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:43.985980 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-e41c6025-fc0f-42c6-a90e-610fcd4ae366 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 200 len: 1304 microversion: 2.1 time: 0.098556 Aug 01 14:22:43.986554 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 681/1348] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:43 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:45.011486 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:45.012184 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: c9318208-e8c5-4977-9ab8-bde2be23746c] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.019523 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.019967 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.020884 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.021441 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.034751 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] HTTP exception thrown: Instance c9318208-e8c5-4977-9ab8-bde2be23746c could not be found. Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Request method failure captured: Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c HTTP/1.1 Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi5-GhTBFfISCQC6AUwLIDdGsrzCXKl-WszuhNOC5tnm-mIufFN5b3Q3g9fl5hLby-1NWmxn_7Pr2TYDWEr-S-KYVa8fi76I1mlueXL823Hw-BirIU3TKBKcOljJtJDrHK_KLH0LcxupiuIcsJvswu2u0zHHqsku0LBXoRfOwU2wLkhXQ Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 57de109e747f4f80a6c572f194367f6c Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesActionsTest-604742306 Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:22:45.036349 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/57de109e747f4f80a6c572f194367f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/57de109e747f4f80a6c572f194367f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_57de109e747f4f80a6c572f194367f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/57de109e747f4f80a6c572f194367f6c"}]}] Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesActionsTest-604742306 Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 57de109e747f4f80a6c572f194367f6c Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesActionsTest-604742306 Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesActionsTest-604742306-project Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: fedc3dfad8284827855defaedda75283 Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesActionsTest-604742306-project Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance c9318208-e8c5-4977-9ab8-bde2be23746c could not be found. Aug 01 14:22:45.038223 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': 'c9318208-e8c5-4977-9ab8-bde2be23746c'} Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9318208-e8c5-4977-9ab8-bde2be23746c could not be found. Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:22:45.039464 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9318208-e8c5-4977-9ab8-bde2be23746c could not be found. Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9318208-e8c5-4977-9ab8-bde2be23746c could not be found. Aug 01 14:22:45.042061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:22:45.043775 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Returning 404 to user: Instance c9318208-e8c5-4977-9ab8-bde2be23746c could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:22:45.043775 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-97772be3-f160-4a5b-979a-4d5213d9c35f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c" status: 404 len: 111 microversion: 2.1 time: 0.030387 Aug 01 14:22:45.043775 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 668/1349] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:45 2022] GET /compute/v2.1/servers/c9318208-e8c5-4977-9ab8-bde2be23746c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:45.087573 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-965249420", "imageRef": "5540580e-ecb3-450f-95d3-3f805a3fafc1", "flavorRef": "452", "networks": [{"uuid": "4558c6e3-7c37-4e92-be98-f6bf06481653"}]}} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:45.139761 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.network.neutron [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] validate_networks() for [('4558c6e3-7c37-4e92-be98-f6bf06481653', None, None, None, None, None)] {{(pid=117857) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 01 14:22:45.497032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Flavor limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 01 14:22:45.497491 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Image limits 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 01 14:22:45.498057 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Flavor pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 01 14:22:45.498515 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Image pref 0:0:0 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 01 14:22:45.499662 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.virt.hardware [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117857) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 01 14:22:45.508685 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.509156 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.510083 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:45.510560 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:45.527158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Getting quotas for project 57de109e747f4f80a6c572f194367f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 01 14:22:45.531163 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.quota [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Getting quotas for user fedc3dfad8284827855defaedda75283 and project 57de109e747f4f80a6c572f194367f6c. Resources: {'cores', 'instances', 'ram'} {{(pid=117857) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 01 14:22:45.541975 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Going to run 1 instances... {{(pid=117857) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 01 14:22:45.544172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5540580e-ecb3-450f-95d3-3f805a3fafc1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117857) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 01 14:22:45.591320 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-a864cfcb-f117-4728-9979-c5fa0b72d080 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.507534 Aug 01 14:22:45.591960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 682/1350] 10.222.0.48 () {60 vars in 1147 bytes} [Mon Aug 1 14:22:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 01 14:22:45.602943 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c7c855b7-4f3f-4497-bb74-268de5535cb8 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:45.603610 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c7c855b7-4f3f-4497-bb74-268de5535cb8 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:45.660587 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c7c855b7-4f3f-4497-bb74-268de5535cb8 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:45.667272 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c7c855b7-4f3f-4497-bb74-268de5535cb8 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1213 microversion: 2.1 time: 0.068214 Aug 01 14:22:45.667845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 669/1351] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:45 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:46.688789 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-56deec0f-ac32-4682-8f52-6da38ce83766 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:46.689413 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-56deec0f-ac32-4682-8f52-6da38ce83766 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:46.695909 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56deec0f-ac32-4682-8f52-6da38ce83766 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.696409 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56deec0f-ac32-4682-8f52-6da38ce83766 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.697146 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56deec0f-ac32-4682-8f52-6da38ce83766 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:46.697583 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-56deec0f-ac32-4682-8f52-6da38ce83766 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:46.762096 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-56deec0f-ac32-4682-8f52-6da38ce83766 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:46.770031 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-56deec0f-ac32-4682-8f52-6da38ce83766 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1271 microversion: 2.1 time: 0.085590 Aug 01 14:22:46.770611 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 683/1352] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:46 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:47.791693 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-458fc245-b662-4c16-a1fc-3245b577966a tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:47.792439 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-458fc245-b662-4c16-a1fc-3245b577966a tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:47.800393 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-458fc245-b662-4c16-a1fc-3245b577966a tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.800970 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-458fc245-b662-4c16-a1fc-3245b577966a tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:47.801941 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-458fc245-b662-4c16-a1fc-3245b577966a tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:47.802592 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-458fc245-b662-4c16-a1fc-3245b577966a tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.091837 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-458fc245-b662-4c16-a1fc-3245b577966a tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:48.101376 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-458fc245-b662-4c16-a1fc-3245b577966a tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1313 microversion: 2.1 time: 0.312678 Aug 01 14:22:48.112548 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 670/1353] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:47 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:48.252388 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [req-43f41d63-6f91-40e4-8581-8dcc88ac6219 req-4a5c6094-b1c1-4450-a303-227f8da0a84b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35d5c16b-7db7-457f-94f6-bcf6271db219", "tag": "1b951353-8faa-45d0-890e-6ba8bd552c3f"}]} {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:48.263046 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-43f41d63-6f91-40e4-8581-8dcc88ac6219 req-4a5c6094-b1c1-4450-a303-227f8da0a84b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:48.263685 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [req-43f41d63-6f91-40e4-8581-8dcc88ac6219 req-4a5c6094-b1c1-4450-a303-227f8da0a84b service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:48.278367 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.compute.server_external_events [req-43f41d63-6f91-40e4-8581-8dcc88ac6219 req-4a5c6094-b1c1-4450-a303-227f8da0a84b service nova] Creating event network-changed:1b951353-8faa-45d0-890e-6ba8bd552c3f for instance 35d5c16b-7db7-457f-94f6-bcf6271db219 on hv-cinder-84713 Aug 01 14:22:48.284074 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [req-43f41d63-6f91-40e4-8581-8dcc88ac6219 req-4a5c6094-b1c1-4450-a303-227f8da0a84b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035377 Aug 01 14:22:48.284708 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 684/1354] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:49.123174 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-78a757fa-23f7-4529-86b2-28125c1d5e48 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:49.124212 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-78a757fa-23f7-4529-86b2-28125c1d5e48 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:49.130704 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78a757fa-23f7-4529-86b2-28125c1d5e48 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.131157 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78a757fa-23f7-4529-86b2-28125c1d5e48 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.131924 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78a757fa-23f7-4529-86b2-28125c1d5e48 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:49.132366 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78a757fa-23f7-4529-86b2-28125c1d5e48 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:49.262631 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-78a757fa-23f7-4529-86b2-28125c1d5e48 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:49.270057 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-78a757fa-23f7-4529-86b2-28125c1d5e48 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1313 microversion: 2.1 time: 0.150856 Aug 01 14:22:49.270629 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 671/1355] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:49 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:50.290994 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-46c1a510-6098-4f20-bb35-6a2f8ec69baa tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:50.291689 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-46c1a510-6098-4f20-bb35-6a2f8ec69baa tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:50.298880 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-46c1a510-6098-4f20-bb35-6a2f8ec69baa tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.299323 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-46c1a510-6098-4f20-bb35-6a2f8ec69baa tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.300071 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-46c1a510-6098-4f20-bb35-6a2f8ec69baa tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:50.300517 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-46c1a510-6098-4f20-bb35-6a2f8ec69baa tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:50.433157 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-46c1a510-6098-4f20-bb35-6a2f8ec69baa tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:50.441382 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-46c1a510-6098-4f20-bb35-6a2f8ec69baa tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1313 microversion: 2.1 time: 0.154509 Aug 01 14:22:50.441949 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 685/1356] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:50 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:51.463001 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a65e170a-d784-47bb-8b2d-93077853e81b tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:51.463804 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a65e170a-d784-47bb-8b2d-93077853e81b tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:51.471469 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a65e170a-d784-47bb-8b2d-93077853e81b tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.472028 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a65e170a-d784-47bb-8b2d-93077853e81b tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.473061 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a65e170a-d784-47bb-8b2d-93077853e81b tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:51.473541 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a65e170a-d784-47bb-8b2d-93077853e81b tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:51.604507 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a65e170a-d784-47bb-8b2d-93077853e81b tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:51.612433 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a65e170a-d784-47bb-8b2d-93077853e81b tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1313 microversion: 2.1 time: 0.153387 Aug 01 14:22:51.613029 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 672/1357] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:51 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:52.634202 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3ccc4062-6555-4584-af03-8a9b8135d7cc tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:52.634735 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3ccc4062-6555-4584-af03-8a9b8135d7cc tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:52.641557 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3ccc4062-6555-4584-af03-8a9b8135d7cc tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.642011 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3ccc4062-6555-4584-af03-8a9b8135d7cc tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.642790 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3ccc4062-6555-4584-af03-8a9b8135d7cc tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:52.643231 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3ccc4062-6555-4584-af03-8a9b8135d7cc tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:52.777592 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3ccc4062-6555-4584-af03-8a9b8135d7cc tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:52.785588 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3ccc4062-6555-4584-af03-8a9b8135d7cc tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1313 microversion: 2.1 time: 0.155369 Aug 01 14:22:52.786158 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 686/1358] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:52 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:53.807475 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6f2e606f-c8fb-44a2-8346-1eb114f10dda tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:53.808205 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6f2e606f-c8fb-44a2-8346-1eb114f10dda tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:53.815774 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f2e606f-c8fb-44a2-8346-1eb114f10dda tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.816239 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f2e606f-c8fb-44a2-8346-1eb114f10dda tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.817041 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f2e606f-c8fb-44a2-8346-1eb114f10dda tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:53.817478 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6f2e606f-c8fb-44a2-8346-1eb114f10dda tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:53.961882 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6f2e606f-c8fb-44a2-8346-1eb114f10dda tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:53.969690 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6f2e606f-c8fb-44a2-8346-1eb114f10dda tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1313 microversion: 2.1 time: 0.166553 Aug 01 14:22:53.970306 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 673/1359] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:53 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:54.991426 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-62881d10-826f-4fc8-b88e-8d2956eb7bf7 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:54.992159 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-62881d10-826f-4fc8-b88e-8d2956eb7bf7 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:55.000032 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-62881d10-826f-4fc8-b88e-8d2956eb7bf7 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.000425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-62881d10-826f-4fc8-b88e-8d2956eb7bf7 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.001249 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-62881d10-826f-4fc8-b88e-8d2956eb7bf7 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.001688 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-62881d10-826f-4fc8-b88e-8d2956eb7bf7 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.142998 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-62881d10-826f-4fc8-b88e-8d2956eb7bf7 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:55.150488 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-62881d10-826f-4fc8-b88e-8d2956eb7bf7 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1313 microversion: 2.1 time: 0.163112 Aug 01 14:22:55.151052 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 687/1360] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:54 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:55.637301 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-15fbc3fc-2b61-4194-b5b0-04754bd9ee96 req-0661bf33-84b6-4f7b-842b-d0137a35bfd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d5c16b-7db7-457f-94f6-bcf6271db219", "name": "network-vif-plugged", "status": "completed", "tag": "1b951353-8faa-45d0-890e-6ba8bd552c3f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:22:55.647096 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-15fbc3fc-2b61-4194-b5b0-04754bd9ee96 req-0661bf33-84b6-4f7b-842b-d0137a35bfd6 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:55.647542 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-15fbc3fc-2b61-4194-b5b0-04754bd9ee96 req-0661bf33-84b6-4f7b-842b-d0137a35bfd6 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:55.659453 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-15fbc3fc-2b61-4194-b5b0-04754bd9ee96 req-0661bf33-84b6-4f7b-842b-d0137a35bfd6 service nova] Creating event network-vif-plugged:1b951353-8faa-45d0-890e-6ba8bd552c3f for instance 35d5c16b-7db7-457f-94f6-bcf6271db219 on hv-cinder-84713 Aug 01 14:22:55.664505 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-15fbc3fc-2b61-4194-b5b0-04754bd9ee96 req-0661bf33-84b6-4f7b-842b-d0137a35bfd6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030735 Aug 01 14:22:55.665059 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 674/1361] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 01 14:22:56.171830 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-3be5b580-a1e9-4641-83ae-5b677b09d69f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:56.172780 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-3be5b580-a1e9-4641-83ae-5b677b09d69f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:56.175960 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.176830 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell0:SELECT=6 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.182722 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3be5b580-a1e9-4641-83ae-5b677b09d69f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.183169 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3be5b580-a1e9-4641-83ae-5b677b09d69f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.183987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3be5b580-a1e9-4641-83ae-5b677b09d69f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:56.184539 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-3be5b580-a1e9-4641-83ae-5b677b09d69f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:56.322046 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-3be5b580-a1e9-4641-83ae-5b677b09d69f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:56.329716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-3be5b580-a1e9-4641-83ae-5b677b09d69f tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1313 microversion: 2.1 time: 0.162421 Aug 01 14:22:56.330318 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 688/1362] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:56 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:57.347280 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:57.352442 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-21a84a97-71fa-43be-8238-fbfc96f402b5 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:57.353181 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-21a84a97-71fa-43be-8238-fbfc96f402b5 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:57.359661 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21a84a97-71fa-43be-8238-fbfc96f402b5 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.360115 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21a84a97-71fa-43be-8238-fbfc96f402b5 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.360907 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21a84a97-71fa-43be-8238-fbfc96f402b5 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:57.361347 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21a84a97-71fa-43be-8238-fbfc96f402b5 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:57.504041 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-21a84a97-71fa-43be-8238-fbfc96f402b5 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:57.512211 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-21a84a97-71fa-43be-8238-fbfc96f402b5 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1496 microversion: 2.1 time: 0.165581 Aug 01 14:22:57.512803 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 675/1363] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:57 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1496 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:58.057411 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-f5baba99-cbcd-4b82-9e3e-c08b26f1ae20 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.057920 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f5baba99-cbcd-4b82-9e3e-c08b26f1ae20 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.065047 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f5baba99-cbcd-4b82-9e3e-c08b26f1ae20 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.065503 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f5baba99-cbcd-4b82-9e3e-c08b26f1ae20 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.066267 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f5baba99-cbcd-4b82-9e3e-c08b26f1ae20 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.066707 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-f5baba99-cbcd-4b82-9e3e-c08b26f1ae20 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.091274 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-f5baba99-cbcd-4b82-9e3e-c08b26f1ae20 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Going to try to terminate instance {{(pid=117857) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 01 14:22:58.094098 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:58.173712 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-f5baba99-cbcd-4b82-9e3e-c08b26f1ae20 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "DELETE /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 204 len: 0 microversion: 2.1 time: 0.120076 Aug 01 14:22:58.174487 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 689/1364] 10.222.0.48 () {58 vars in 1239 bytes} [Mon Aug 1 14:22:58 2022] DELETE /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 01 14:22:58.183327 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-57f19977-51f3-4353-8078-48aa50078ea9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:58.183945 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-57f19977-51f3-4353-8078-48aa50078ea9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:58.190845 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-57f19977-51f3-4353-8078-48aa50078ea9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.191318 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-57f19977-51f3-4353-8078-48aa50078ea9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.192087 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-57f19977-51f3-4353-8078-48aa50078ea9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:58.192554 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-57f19977-51f3-4353-8078-48aa50078ea9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:58.319879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-57f19977-51f3-4353-8078-48aa50078ea9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:58.327449 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-57f19977-51f3-4353-8078-48aa50078ea9 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1502 microversion: 2.1 time: 0.148372 Aug 01 14:22:58.328431 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 676/1365] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:58 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:22:59.349771 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-49f58e69-74a5-4c2a-9ea7-12680d523ba3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:22:59.350482 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-49f58e69-74a5-4c2a-9ea7-12680d523ba3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:22:59.354161 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG dbcounter [-] [117857] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117857) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:59.358757 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-49f58e69-74a5-4c2a-9ea7-12680d523ba3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.359204 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-49f58e69-74a5-4c2a-9ea7-12680d523ba3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.359987 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-49f58e69-74a5-4c2a-9ea7-12680d523ba3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:22:59.360425 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-49f58e69-74a5-4c2a-9ea7-12680d523ba3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:22:59.511252 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-49f58e69-74a5-4c2a-9ea7-12680d523ba3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:22:59.519455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-49f58e69-74a5-4c2a-9ea7-12680d523ba3 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1502 microversion: 2.1 time: 0.174202 Aug 01 14:22:59.520020 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 690/1366] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:22:59 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:00.191297 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-f2928bde-57e3-4562-894f-699bd0df44bd req-3d1516f6-38bc-4ba1-9ae3-8ef9fc7e9cf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35d5c16b-7db7-457f-94f6-bcf6271db219", "name": "network-vif-deleted", "tag": "1b951353-8faa-45d0-890e-6ba8bd552c3f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 01 14:23:00.197123 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=41 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:00.204050 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f2928bde-57e3-4562-894f-699bd0df44bd req-3d1516f6-38bc-4ba1-9ae3-8ef9fc7e9cf9 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.204613 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f2928bde-57e3-4562-894f-699bd0df44bd req-3d1516f6-38bc-4ba1-9ae3-8ef9fc7e9cf9 service nova] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.207151 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=85 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:00.219194 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-f2928bde-57e3-4562-894f-699bd0df44bd req-3d1516f6-38bc-4ba1-9ae3-8ef9fc7e9cf9 service nova] Creating event network-vif-deleted:1b951353-8faa-45d0-890e-6ba8bd552c3f for instance 35d5c16b-7db7-457f-94f6-bcf6271db219 on hv-cinder-84713 Aug 01 14:23:00.225023 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-f2928bde-57e3-4562-894f-699bd0df44bd req-3d1516f6-38bc-4ba1-9ae3-8ef9fc7e9cf9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037251 Aug 01 14:23:00.225662 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 677/1367] 10.222.0.48 () {64 vars in 1317 bytes} [Mon Aug 1 14:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 01 14:23:00.540461 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.api.openstack.wsgi [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117857) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:00.541145 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.compute.api [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117857) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:00.548205 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.548700 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.549468 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.549912 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.583104 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:00.583698 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG oslo_concurrency.lockutils [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117857) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:00.584172 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.objects.instance [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lazy-loading 'fault' on Instance uuid 35d5c16b-7db7-457f-94f6-bcf6271db219 {{(pid=117857) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 01 14:23:00.631612 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: DEBUG nova.policy [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fedc3dfad8284827855defaedda75283', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57de109e747f4f80a6c572f194367f6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117857) authorize /opt/stack/nova/nova/policy.py:199}} Aug 01 14:23:00.639295 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO nova.api.openstack.requestlog [None req-fd211324-2043-469c-927e-ee47ea21ca27 tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 200 len: 1303 microversion: 2.1 time: 0.102752 Aug 01 14:23:00.639860 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: [pid: 117857|app: 0|req: 691/1368] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:00 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 01 14:23:01.660722 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 01 14:23:01.661436 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] [instance: 35d5c16b-7db7-457f-94f6-bcf6271db219] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 01 14:23:01.668046 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.668527 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.669982 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 01 14:23:01.670414 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Lock "c66651a9-c088-4404-8a00-ed3d7b34326a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 01 14:23:01.684224 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] HTTP exception thrown: Instance 35d5c16b-7db7-457f-94f6-bcf6271db219 could not be found. Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Request method failure captured: Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 HTTP/1.1 Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept: application/json Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Connection: close Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Length: 0 Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Content-Type: application/json Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Host: 10.222.0.48 Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.10 Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABi5-GhTBFfISCQC6AUwLIDdGsrzCXKl-WszuhNOC5tnm-mIufFN5b3Q3g9fl5hLby-1NWmxn_7Pr2TYDWEr-S-KYVa8fi76I1mlueXL823Hw-BirIU3TKBKcOljJtJDrHK_KLH0LcxupiuIcsJvswu2u0zHHqsku0LBXoRfOwU2wLkhXQ Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Id: 57de109e747f4f80a6c572f194367f6c Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesActionsTest-604742306 Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Role: reader,member Aug 01 14:23:01.685999 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/57de109e747f4f80a6c572f194367f6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/57de109e747f4f80a6c572f194367f6c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_57de109e747f4f80a6c572f194367f6c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/57de109e747f4f80a6c572f194367f6c"}]}] Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesActionsTest-604742306 Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 57de109e747f4f80a6c572f194367f6c Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesActionsTest-604742306 Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesActionsTest-604742306-project Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Id: fedc3dfad8284827855defaedda75283 Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesActionsTest-604742306-project Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: method: > Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: exception: Instance 35d5c16b-7db7-457f-94f6-bcf6271db219 could not be found. Aug 01 14:23:01.687573 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: action_args: {'id': '35d5c16b-7db7-457f-94f6-bcf6271db219'} Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35d5c16b-7db7-457f-94f6-bcf6271db219 could not be found. Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 01 14:23:01.688406 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35d5c16b-7db7-457f-94f6-bcf6271db219 could not be found. Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35d5c16b-7db7-457f-94f6-bcf6271db219 could not be found. Aug 01 14:23:01.689879 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Aug 01 14:23:01.691130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] Returning 404 to user: Instance 35d5c16b-7db7-457f-94f6-bcf6271db219 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 01 14:23:01.691130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-baf0a6dd-f5fa-46e3-bba4-a5e1914fc4db tempest-VolumesActionsTest-604742306 tempest-VolumesActionsTest-604742306-project] 10.222.0.48 "GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219" status: 404 len: 111 microversion: 2.1 time: 0.031399 Aug 01 14:23:01.691130 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 678/1369] 10.222.0.48 () {58 vars in 1236 bytes} [Mon Aug 1 14:23:01 2022] GET /compute/v2.1/servers/35d5c16b-7db7-457f-94f6-bcf6271db219 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 01 14:24:04.225851 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:24:04.227094 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Mon Aug 1 14:24:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:25:45.375657 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:25:45.376314 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Mon Aug 1 14:25:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:25:47.573754 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:25:47.574464 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Mon Aug 1 14:25:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:25:58.072299 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:25:58.072796 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Mon Aug 1 14:25:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:26:04.814851 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:26:04.815473 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Mon Aug 1 14:26:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:27:24.235128 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:27:24.235930 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Mon Aug 1 14:27:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:27:29.315888 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:27:29.316545 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Mon Aug 1 14:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:29:05.384493 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:29:05.385251 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Mon Aug 1 14:29:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:29:07.582795 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:29:07.583716 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Mon Aug 1 14:29:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:29:18.080544 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:29:18.081142 dv-cinder-847131-3-iscsi devstack@n-api.service[117859]: Mon Aug 1 14:29:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 01 14:29:24.824986 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 01 14:29:24.825455 dv-cinder-847131-3-iscsi devstack@n-api.service[117857]: Mon Aug 1 14:29:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!